CASMI 2022 - Results

Thank you for your participation in the CASMI 2022! This CASMI trial was aimed mostly to gauge which methods are used by the community, with which method or parameter variants, and how close we are with respect to compound ID of unknowns.

An excerpt of methods used by the participants, and uploaded submitted results, can be found here: https://drive.google.com/drive/u/3/folders/12cCAdUjV_mXZ7tavdz9A_r18B6rDk437

A big round of applause and a "Thank you" shoutout also to the CASMI panelists and those of you who sent in recordings to share your thoughts on the CASMI 2022 trial.

List of participants:

  1. Adamo Young - U. of Toronto
  2. Adriano Rutz - U. of Geneva
  3. Armando Alcazar - U. of British Columbia
  4. Carl Namini & Jonathan Mosley - the United States Environmental Protection Agency
  5. David Elser - U. of Strasbourg
  6. Dejan Nikolic - U. of Illinois Chicago
  7. Fei Wang - U. of Alberta
  8. Gianfranco Frigerio & Begona Talavera Andujar - U. of Luxembourg
  9. Hiroshi Tsugawa - Tokyo U. of Agriculture & Technology
  10. Kai Dührkop - U. of Jena
  11. Louis-Félix Nothias - U. of Geneva
  12. Sajjan Mehta & Paolo Bonini - oloBion
  13. Shipei Xing - U. of British Columbia
  14. Si Wei - Nanjing U.
  15. Habtom Ressom - OmicsCraft LLC
  16. Yuhui Hong - Indiana U.
Map showing various locations around the world marked with blue pins.

Results will be discussed based on four different categories:

1. Correct annotation of adducts

2. Correct elemental formulas

3. Correct compound structure classes

4. Correct 2D chemical structures

View workshop presentation here: https://drive.google.com/drive/folders/1h3Hf8vxDQUhDN9aIRKIOBKGR91qgg3cL?usp=sharing


Correct annotation of adducts

GroupPriority/BonusTotal Attempts for AdductsCorrect number of AdductsCorrect % of Adducts
Hong_pubpriority2493213
Hong_pred and pubpriority2494518
Wangpriority24913554
Ressompriority23412955
Youngpriority1307457
Alcazarpriority22314967
Frigerio/Andujar_msdialpriority19613167
Namini/Mosleypriority23916669
Rutzpriority22816271
Xingpriority24618776
Frigerio/Andujar_patroonpriority221777
Wei_MSKU_1priority24920884
Wei_MSKU_2priority24920984
Wei_MSKU_3priority24920984
Mehtapriority15613385
Tsugawapriority24922289
Nothiaspriority22820992
Duhrkoppriority22220793
Nikolic_POSOpriority797494
Nikolic_KUCApriority1029694
ElserpriorityDid not submitDid not submitDid not submit

 

GroupPriority/BonusTotal Attempts for AdductsCorrect number of AdductsCorrect % of Adducts
Hong_pubbonus2474016
Hong_pred and pubbonus2475121
Wangbonus24714760
Mehtabonus332473
Rutzbonus21916776
Xingbonus24721487
Nothiasbonus21920895
Duhrkopbonus21921096
ElserbonusDid not submitDid not submitDid not submit

Correct elemental formulas

GroupPriority/BonusTotal Attempts for FormulasCorrect number of FormulasCorrect % of Formulas
Youngpriority13000
Hong_pubpriority24983
Hong_pred and pubpriority249208
Frigerio/Andujar_patroonpriority22523
Ressompriority2347432
Wangpriority2499137
Namini/Mosleypriority23813657
Frigerio/Andujar_msdialpriority19611358
Alcazarpriority22214565
Wei_MSKU_3priority24817269
Wei_MSKU_1priority24818173
Wei_MSKU_2priority24818474
Tsugawapriority24918675
Xingpriority24618475
Mehtapriority15611775
Nikolic_KUCApriority1028684
Nikolic_POSOpriority796987
Rutzpriority22820891
Nothiaspriority22821193
Duhrkoppriority22220894
ElserpriorityDid not submitDid not submitDid not submit

 

GroupPriority/BonusTotal Attempts for FormulasCorrect number of FormulasCorrect % of Formulas
Hong_pubbonus247125
Hong_pred and pubbonus247219
Wangbonus2478635
Mehtabonus332061
Xingbonus24621186
Rutzbonus21920694
Nothiasbonus21920694
Duhrkopbonus21920795
ElserbonusDid not submitDid not submitDid not submit

Correct compound structure classes

GroupPriority/BonusTotal Attempts of ClassesCorrect number of ClassesCorrect % of Classes
Nikolic_POSOpriority3613
Nikolic_KUCApriority52510
Hong_pubpriority1835228
Hong_pred and pubpriority1795631
Frigerio/Andujar_msdialpriority1354735
Namini/Mosleypriority1858345
Frigerio/Andujar_patroonpriority13646
Tsugawapriority18710657
Alcazarpriority1357757
Nothiaspriority17810760
Rutzpriority17610660
Mehtapriority1227763
Wangpriority19513167
Duhrkoppriority16811669
YoungpriorityDid not submitDid not submitDid not submit
RessompriorityDid not submitDid not submitDid not submit
Wei_MSKU_3priorityDid not submitDid not submitDid not submit
Wei_MSKU_1priorityDid not submitDid not submitDid not submit
Wei_MSKU_2priorityDid not submitDid not submitDid not submit
XingpriorityDid not submitDid not submitDid not submit
ElserpriorityDid not submitDid not submitDid not submit

 

GroupPriority/BonusTotal Attempts of ClassesCorrect number of ClassesCorrect % of Classes
Hong_pubbonus1755330
Hong_pred and pubbonus1765833
Mehtabonus281657
Rutzbonus17212070
Nothiasbonus17212271
Duhrkopbonus16512375
Wangbonus19414977
XingbonusDid not submitDid not submitDid not submit
ElserbonusDid not submitDid not submitDid not submit

Correct 2D chemical structures

GroupPriority/BonusTotal Attempts of 2D StructureCorrect number of 2D StructureCorrect % of 2D Structure
Youngpriority13000
Elserpriority9700
Hong_pubpriority24931
Hong_pred and pubpriority24931
Ressompriority234104
Frigerio/Andujar_patroonpriority2215
Wei_MSKU_3priority247125
Alcazarpriority215126
Frigerio/Andujar_msdialpriority196116
Wei_MSKU_2priority247146
Wei_MSKU_1priority247187
Wangpriority249239
Namini/Mosleypriority2352511
Tsugawapriority2413012
Xingpriority2463715
Nikolic_POSOpriority37719
Mehtapriority1563221
Nothiaspriority2285825
Rutzpriority2285825
Duhrkoppriority2225726
Nikolic_KUCApriority552138

 

GroupPriority/BonusTotal Attempts of 2D StructureCorrect number of 2D StructureCorrect % of 2D Structure
Elserbonus12200
Hong_pubbonus24752
Wangbonus247104
Hong_pred and pubbonus247156
Xingbonus2463113
Mehtabonus33721
Rutzbonus2196228
Nothiasbonus2196228
Duhrkopbonus2196429