Recently I had the pleasure of dealing with a player who began creating their character from a supplement downloaded from the Internet. They were surprised when I told them it would not do. Of course, I soon heard that their head-hunter was entitled to certain skills, and who knows what else, because the supplement said so. It never occurred to them that if I will not accept the claim that a particular clan's background entails a skill from a player I know and trust, I will not accept it from the anonymous owner of an unfamiliar website either. Why would I? Why should that supplement's author's opinion carry more weight than any player's? An Internet supplement is not an authority you can invoke. Of course, it is not entirely useless either. In many cases, using such online supplements can save us time. If a supplement is good, we do not need to solve again what its creator has already solved. Looking through it soon tells us whether we trust it and accept the rules it describes.
Of course, we may also say of an author's work: so far I have liked their view of the world and adapted to it, so why not accept their newer writings? We may even accept an author's work without reviewing it. For that, though, it helps to know at least the date. A supplement I wrote fifteen years ago would have exactly fifteen fewer years of experience behind it than my current solutions. Indeed, some of my earlier writing is not an accepted authority when I am GMing, simply because it is terribly outdated. Of course, fifteen years ago I too tried numerous methods of calculating approximately what combat values a better or magical weapon might have. Although I considered many possibilities and issues of balance, the supplement is nevertheless extremely dated.
For example, because it does not account for psychology. If you can imagine yourself winning, that is already half the victory.
If your weapon's special material gives you confidence, while your opponent fears the advantages of that special weapon, fears that someone wielding an expensive abbith weapon is surely no ordinary person, and fears not knowing your weapon, they become uncertain. It is not only the weapon's objective advantages that decide things: the opponent's uncertainty matters too. They do not know what to expect from the lighter, stronger abbith weapon, or who might come out ahead in a clash or a forceful parry. An uncertain fighter makes mistakes. This too is an advantage of a weapon made from a special material.
I did not account for the fact that a weapon made of better material offers different possibilities. Partly for the smith: they can make a lighter weapon or play with its balance, because the better material can withstand different things. But many of these benefits are not automatic, and many of these choices are not necessarily compatible with various forging techniques. Tough luck. And partly for the wielder: they know their weapon is stronger and can come out of many combat situations better as a result. But in many situations, exactly how much stronger it is makes no difference.
Fighting with a weapon of a different design, material or strength, and taking advantage of its benefits, probably requires a skill, however. So I would have to expand the list of skills that can be learned alongside Master-rank Weapon Use, even if the Basic rank of some such skills costs “0 KP.” The experience of recent years is enough for me to handle weapons made of special materials with completely different rules. Of course, there are groups where I do not change the old solution during an ongoing game. There my older writing remains the guide, so the world does not “suddenly start changing” in the middle of an adventure. And, of course, there are groups where I use the new solution.
That does not mean the original supplement is not still perfectly usable today. It merely means that it can be thought through further and developed. And today I use that further-developed version. It would be a serious problem if I abandoned the more considered solution for an earlier version because someone happened to download it from the Internet as a “supplement.”
At the same time, I would be a fool to develop something I know someone else has already developed, when I would arrive at neither a better solution nor a fundamentally different one. In those cases I happily use solutions from other game masters, experienced players and so on. Not because “someone wrote them down,” but because they are good and already available. That is a major advantage. The time I save by not having to develop these things again can go toward working out another detail and giving the game a little more depth elsewhere.