Ahmed et al. (2023) reported that private businesses' share of the biggest AI models increased from 11% in 2010 to 96% in 2021.
Sources
- Can We Trust AI Benchmarks? An Interdisciplinary Review ... (arxiv.org)
- https://www.science.org/stoken/author-tokens/ST-1055/full (science.org)
- https://www.brookings.edu/articles/what-should-be-done-about-the-growing-influence-of-industry-in-ai-research/ (brookings.edu)
- https://ide.mit.edu/wp-content/uploads/2023/03/0303PolicyForum_Ai_FF-2.pdf (ide.mit.edu)
More in Technology
- Google researchers labeled gender categories in their smile-detection model as 'Gender 1' and 'Gender 2' specifically to reduce the risk of introducing unconscious societal bias.
- In an analysis of 24 state-of-the-art language-model benchmarks, Reuel et al. (2024) found that only 4 provided scripts for replicating results, and no more than 10 performed multiple evaluations or reported statistical significance.
- The QWERTY keyboard layout was designed in the 1870s partly to prevent mechanical typewriter jams by separating commonly used letter pairs.
- The NSA released two technical reports addressing threats to application-specific integrated circuits (ASICs).
- Atlas matched human pathologists' conclusions 97.1% of the time when categorizing cancerous colorectal tissue.
- On classifying tumors from prostate cancer biopsies, Atlas's score was only 70.5%, despite exceeding the other models' highest scores on that task.