[Mne_analysis] Call to predict the replicability of influential EEG studies

Thu May 23 05:36:48 EDT 2024

        External Email - Use Caution        

Hi MNE users –

Apologies for cross posting!

I want to forward a call for EEG users to participate in a project on predicting if the findings of a set of influential EEG studies will replicate.
You will register your predictions (we provide information sheets for each study to base your decision on), and the studies will actually be replicated over the coming years so that we can validate the predictions.

If you have worked with EEG or MEG before, it would be great if you participated!
It will give us important data on researchers’ expectations and confidence in the context of replication studies and you will earn money for a charity of your choice (and potentially yourself).

Participation is possible until June 2. More details below.

We would be grateful if you could also forward this call to your colleagues and students.

Cheers,
Dominik

---------------------------------------------------------------------------------------------------------------------------

Prediction markets for #EEGManyLabs

---------------------------------------------------------------------------------------------------------------------------

#EEGManyLabs is an international network of researchers who have come together to assess the replicability of some of the most important and influential EEG experiments of psychological phenomena (Pavlov et al., 2021<https://secure-web.cisco.com/1XtKK-pAjpDhK7RPcrNFwhd5NeJkXG4GLJuM4039R22NsyVI6pklCLgiFih85of0-d07Yt4lPcnj1AXt7CPVaq1otnz4bJD4z3yIT2L31re5GVUETtXmRTlxOCyAhs9KcQq1RzBsf5qQuZ9cYIH0epTDVlRTKzCFbcCByW4KN01TMzuvoT6szJ3e70LgsexXmTlE-MvUkKJKQJ3UXwjbmpmr1LHFyRKbqCQ4ioVh-_x-UTUhImKQHrZ120WQen9WdChp-gnEVcd73YTcVqjwD3xvOmlM-GR1mZ31S3iYhOhuV0lwL3J1wxgaCcHgB2sC7cACJHoxSdsomb5O3AfBOag/https%3A%2F%2Fwww.sciencedirect.com%2Fscience%2Farticle%2Fpii%2FS0010945221001106>).
To participate, we will first ask you to complete a detailed survey to gather your expert opinion on the replicability of some hypotheses studied in the #EEGManyLabs project. Each hypothesis is supplemented by a short description of the background and the statistics used for the hypothesis test in the original study (also available here<https://secure-web.cisco.com/1VP28a9k6ubnUIkDG0c_Ff68vkTl80fD6Le2-WeH2-ML1nM3NVt9u0sCEDZbhhQpnmMaxhMkS6cp_NGgQa0zyTkhFx3J7S5lP0aRo37G4ut7m6wSctqWEmogCE67sxailVFWVCeWtpG729VC32s6kPufvuxdEoWf-9o8OVlQ27C-F_A2DIEaipQ5eVd8RNXAWWTqiBKwpAAt6Kw6cQHSme7CzwkQgparVd1_ZJMZRGvVgCF8U_GuuUA68RMj9R3OOHrOKr-1fgZKQk-be3JbUr-S73n40hcMDBdzGp7wdHxkQntMkp6FAOD0WtIZn6sSW_jjd8v6ZFvnXmGN2BDg5_A/https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1E1b-hH0X7WZs9ijl0ry-snw1hU5gbDmG0Dd3HKFj-BM%2F>

). While this survey is comprehensive and may require some time to complete, your insights are crucial for enriching our understanding of how experts in our field are capable of predicting the outcomes of complex hypotheses. The results of the survey and prediction markets will also tell us about the degree of optimism/pessimism amongst the EEG community.

Subsequently, you will be invited to bet (between June 3rd-14th) on the likelihood of success through a stock market platform. In the process you will earn $10USD for a selected charity immediately and up to $300 USD (for you as a gift voucher or charity) when the results are completed.

To ensure that our results are truly representative, we urge you to involve as many colleagues as possible, including PhD and postdoctoral researchers. Your participation is vital. Please help us by completing the survey yourself and by sharing the sign-up form widely.

TL;DR

Step 1: Survey (link here<https://secure-web.cisco.com/1HxzseSGa-DRMm_5AmewRE7h2lrKECMYnenQKB68rB547tyz0NsizFPwRnZAw3ioijjzJeFbNq8hlYxe7F2b8VlHbrNmgMKJUYZIQKk3XDD6kVEv5GpOA9iqQGJV9U7cG1V9UNwryVLybvE76gsXeij0gY9G7cM-afPmnNl9bLIkzG4Da116WD6Q0-RlZNWCVr8EgTxARfTSKuOJD9ru7fd9CXFhTtqTQEg7mvF2IQAIY4GAq3XEFZA32OzeKbJa5FjOhqyH1Txz67jr33av7_U7nGuA6PZ7veL3LfOxCFDpCveou9-twWVONZ_AdZ7MqMrXkQWRZ5Q4HkMTR3fd4-g/https%3A%2F%2Fleedspsychology.eu.qualtrics.com%2Fjfe%2Fform%2FSV_b7NN5sQvZpynI2O>. Takes ~60 mins. TBC in May)

Step 2: Betting! (June)

How can I sign up for the prediction markets?

Registrations to participate in the prediction markets are administered via form<https://secure-web.cisco.com/1HxzseSGa-DRMm_5AmewRE7h2lrKECMYnenQKB68rB547tyz0NsizFPwRnZAw3ioijjzJeFbNq8hlYxe7F2b8VlHbrNmgMKJUYZIQKk3XDD6kVEv5GpOA9iqQGJV9U7cG1V9UNwryVLybvE76gsXeij0gY9G7cM-afPmnNl9bLIkzG4Da116WD6Q0-RlZNWCVr8EgTxARfTSKuOJD9ru7fd9CXFhTtqTQEg7mvF2IQAIY4GAq3XEFZA32OzeKbJa5FjOhqyH1Txz67jr33av7_U7nGuA6PZ7veL3LfOxCFDpCveou9-twWVONZ_AdZ7MqMrXkQWRZ5Q4HkMTR3fd4-g/https%3A%2F%2Fleedspsychology.eu.qualtrics.com%2Fjfe%2Fform%2FSV_b7NN5sQvZpynI2O>. You must have experience of working with EEG (for example, through collecting and/or analysing EEG data).

Timeframes

Registration to participate in the markets (through completion of the survey) will close on June 2 at 4 pm UTC.

The prediction markets will then open on June 3 and you will be able to place your bets until June 14.

How will market participation be incentivized?

Trading on the prediction markets will be incentivized, i.e., traders will be paid based on their market performance. Payments will be made after the markets close, and the payoffs are determined by the actual replication outcomes. When signing up for the markets, participants can indicate whether the final payment shall be paid via an Amazon Gift Card or donated to charity. In addition, all participants in the prediction markets will be allocated USD $10 to allocate to one charity (out of several options) that will be paid out immediately after the markets have closed. More information on the prediction markets is available here<https://secure-web.cisco.com/1PNskTkKksOA8eofVHLyKa4wdIVRaZdyF63aFwSfp6m4OfTty9eG_Xm8-JLrWPnysW4ADKaFPhlRs4gGx78Jc5xRMSEoeqbRQBy9-hpugTyvjdXEvKVePYpS3PBf3hKblXjbkBVOs0ejXhwfvylS1iaZABRDUgYyWDZDLMtKhUJmQcfPNLwWzGT_aosRu8UgrgY0_9a9G3PKT6ePHiq5nA6Kw_Ssr-XBij2fzCGLBpRx6shdL-46A7R__hCZ_C7ef3XvhEl3oiN3_TRYW1Xve5x6sLZ2u8YuMa9RaLUyN8rCC0P12Y7nnFY-JkbrnGgyQP-bzUQO-dmdahEAN8w0Lzw/https%3A%2F%2Fosf.io%2Fga5ry>.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.nmr.mgh.harvard.edu/pipermail/mne_analysis/attachments/20240523/304e83f8/attachment-0001.html 