Transformer architectures emerged in 2017, leading to a significant leap in AI capabilities.
Sources
- Global AI Governance—Part 1: Decoding Developers and Deployers | Oxford Law Blogs (blogs.law.ox.ac.uk)
- https://arxiv.org/abs/1706.03762 (arxiv.org)
- https://research.google/blog/transformer-a-novel-neural-network-architecture-for-language-understanding/ (research.google)
- https://arxiv.org/pdf/2302.07730 (arxiv.org)
- https://techspot.com/article/2933-meet-transformers-ai/ (techspot.com)
More in Technology
- JPEG compression levels used in API calls can change the ranking lineup of models on visually prompted benchmarks.
- The Supreme Court's online docket search allows users to search by docket number, case name, or other words or numbers appearing in the docket report.
- The US Copyright Office is refusing to grant copyrights to images and text generated by AI, a policy that has raised concerns from organizations including the Motion Picture Association of America.
- American Memory provided electronic versions of primary-source materials in multiple formats, including manuscripts, films, sound recordings, and photographs.
- Nantero's 'universal memory,' featured in MIT Technology Review's 2005 Breakthrough Technologies list, used carbon nanotubes intended to replace flash memory, random-access memory, and hard disk drives, but tiny variations in nanotube arrangement caused errors when the company tried to manufacture it at scale.
- A laptop belonging to former IRS Criminal Investigation (IRS-CI) agent Chris Janczewski held the cryptographic keys used to seize $3.6 billion in stolen bitcoin.