We are a small research team dedicated to NLP improvement. Curiosity and the willingness to push the boundaries of human understanding drives our effort to improve the current status of AI development. Find out more at: www.apergo.ai
Why do I see some counterfactuals or answers a second or third time?
The information is randomly selected. Especially in the beginning with limited number of users and AI answers, you could see some answers multiple times. Just classify them a second time according to your judgment.
Do the answers remain in the judgment pool forever?
No, as soon as a 95% agreement is reached wether the answer is correct or incorrect (with at least 20 classifications) the answer-classification is marked as finalized and won't be issued again. Upon completion of all answers of an participating AI the final score is settled.