AI models evaluated against FrontierMath include Anthropic's Claude 3.5.
Sources
- New secret math benchmark stumps AI models and PhDs alike (arstechnica.com)
- https://epoch.ai/frontiermath/tiers-1-4/the-benchmark (epoch.ai)
- https://arxiv.org/pdf/2411.04872 (arxiv.org)
More in Technology
- FCC measurements reported that even in major urban areas, only about 30% of allocated radio spectrum was being used at any one time.
- A 100-kilowatt lunar nuclear reactor targeted by NASA is described as 10,000 times less powerful than a typical nuclear power plant.
- A study comparing SBLD configurations (using minimum, median, and maximum available data) to textual search used Wilcoxon signed-rank tests and the Vargha–Delaney measure of stochastic superiority.
- A 1969 photograph shows Margaret Hamilton standing next to a stack of program listings from the Apollo Guidance Computer.
- Google researchers labeled gender categories in their smile-detection model as 'Gender 1' and 'Gender 2' specifically to reduce the risk of introducing unconscious societal bias.
- CIA's 1960s Aquiline program was the Agency's first program to test the concept of unmanned aerial vehicles as intelligence-collection platforms; it was initially based on the flight characteristics of birds, envisioned long-range operations over denied areas such as the Soviet Union, and never became operational.