Article Index

When I suggested that Sol write the next article, it was not primarily about his professional knowledge. We are not trying to write a tutorial, merely to draw attention to a few things. To explore a subject from a roleplayer's perspective. But the truth is that even so, the most interesting stories about questionnaires require a level of knowledge that only he possesses among the site's team. We are preparing an article, perhaps a series, about the period of Hungary's transition from communism for Call of Cthulhu players. But it is equally true that today's young players may have missed many political or scientific subjects from the first decade of our millennium too. Information technology also developed during this time: in the late 1980s, ordinary people scarcely had internet access, let alone questionnaire software. But it was not just the tools that developed; questionnaire designers found solutions to ever more new problems.

If every pollster's seat projection for an election was completely wrong, there were reasons for that, and methodology evolved. Somehow they had to find out the concealed answers too, and answers the respondents themselves did not know. The polling organizations, staffed predominantly by professionals one and all, were badly wrong, and there was plenty to correct. Many replaced their entire methodology for projecting seats. The point came when they had to say: the world has changed. A questionnaire, a research methodology that worked brilliantly yesterday had failed, not just here but in numerous other places around the world. The internet, the replacement of tools, and social changes all appeared in succession. Indeed, television voting offers an interesting detour into the territory between questionnaires and Facebook polls.

One defining moment in the rivalry between TV2 and RTL Klub came when both stations considered buying Big Brother. RTL Klub, however, decided to emphasize luxury instead, include filming at outside locations, and, of course, approach the business behind the entire series differently. It would not matter if TV2 won the battle by buying the original and achieving higher viewing figures, provided RTL Klub won the war. The goal was more direct revenue, which would mean more money to buy and produce programs later. And they would even avoid the royalties. Somehow or other, Való Világ beat TV2 in the ratings battle too. Much of that required the market research behind developing the format. But people had to be persuaded not only to follow the online broadcast, but to vote too. 

They needed people for whom viewers would vote practically without limit, even by setting government offices' telephone exchanges to vote automatically and thus defrauding their workplaces; yet those people also had to be divisive enough to keep viewers glued to the screen, whether because they loved them or hated them and wanted to be well informed about the show. Serious market research preceded casting. It had to keep competitors from recognizing the strategic goals, and extract answers from respondents who publicly said they did not watch such things but sat down to them every evening anyway. Recognizing these people's unrecognized and concealed preferences made it possible to know what kinds of people and situations the show needed, how to beat TV2. The rest is history. 

This was the point when the view that TV2 could fuck up even the best format, while RTL Klub could beat them with less impressive material, became particularly conspicuous. Numerous experiences reinforced it, and by the time TV2 acquired the label of government mouthpiece, it had little chance of recovering. Because voting cost money, however, it measured not so much popularity as the size of solvent demand. Counted not per person, but per forint. Yet they also needed to see what kinds of people and situations increased revenue during an eviction vote, and the voting results, along with independent measurements and studies, influenced what happened in the editing room and what tasks contestants received. And, of course, the advice whispered to them by the editors. 

Today, everything revolves around the fact that you or I can have a questionnaire. There is a free plan for it. Only the resulting survey will usually not be good. We often hear “the survey is not representative” and see a questionnaire failing to reach its most important target audience. We speak Hungarian; everyone knows how to ask questions. What could go wrong? Except that many of the cases above show that professionals sometimes get it wrong too. And most roleplayers making questionnaires on this basis are not even professionals. And we see the spectacular successes.

What these successes share is attention to the public mood throughout the research. They did not merely throw together a generally good questionnaire: they considered the circumstances in which it would ask its questions, and whom it would ask. And right now, it makes sense to ask different things of someone playing the Hungarian-language version of Call of Cthulhu, someone using the d20-based version, and someone whose foundation is the newest English-language core rulebook. Indeed, we ask different questions again when targeting roleplayers who do not yet play Call of Cthulhu. Or fans of Lovecraft's work who do not yet play roleplaying games. 

Opinion polls miss the mark in numerous cases. They did not really predict Trump's victory either. Yet there were plenty of parameters measurable by questionnaire that would have shown it early. A social phenomenon we know well because we are part of it. Pillars of Eternity being censored because of SJWs? A questionable professional joining the Mass Effect team because of SJWs? A favorite comedian refusing to perform in many places because of SJWs? These problems appear online and spread quickly enough. This increased the chances of victory for Trump, who firmly opposed political correctness and SJWs. The voting bloc this could reach was stable; his competitors ground one another down. People could debate how to interpret his scandalous words, but every statement still sent a clear message to groups opposed to PC. 

Failing to measure what matters, what could be decisive, is one of the greatest mistakes. Yet many universities and other intellectual institutions have never been ideologically neutral. Where PC seems a fundamental value and the SJW attitude natural, people will not measure this, because of their own convictions. The true enemy of truth is much less the lie than the conviction that prevents the facts from coming to light. Lies, after all, can be disproved. Conviction is far harder to correct, especially when the researcher brings it into the research themselves.