OpenAI Announces Successful Creation of GPT-4
On March 14th, 2023, OpenAI announced the successful creation of GPT-4, a large multimodal artificial intelligence that accepts image and text inputs and emits text outputs. GPT-4 exhibits outstanding human-level performance on various professional and academic benchmarks and examinations worldwide.
GPT-4 is the successor to GPT 3.5, the large AI language model that powers ChatGPT.
GPT-4’s Impressive Performance
According to the research whitepaper published by OpenAI, GPT-4 can pass a simulated Bar Exam with a score around the top 10% of test takers. In contrast, GPT-3.5’s score was around the bottom 10%. GPT-4 also aces university entrance exams, including but not limited to the AP exams and the SAT exams.
To understand the difference between the two models, OpenAI has tested GPT-4 on a variety of benchmarks, including simulating exams that were originally designed for humans. OpenAI has stated that GPT-4 is taking the most recent publicly-available tests or 2022-2023 editions of practice exams purchased by OpenAI. It should be noted that the exams tested by OpenAI are mostly US-centric, such as the SAT and AP exams. Global equivalents to both of the exams include the GCE Cambridge A Levels or an equivalent diploma.
Highlights of GPT-4’s Exam Results
- GPT-4 has finished and aced the Uniform Bar Exam (MBE+MEE+MPT) in the top 10% of all scorers with a score of 298/400, compared to the bottom 10% by GPT 3.5.
- For the SATs, GPT-4 placed in the top 12% of the LSAT (law school admission test), top 7% in SAT Evidence-Based Reading & Writing and top 11% in SAT Math.
- In the AP exams, GPT-4 is placed within the top 15% in AP Biology, the top 30% in AP Chemistry, the top 34% in AP Physics 2, the top 15% in AP Statistics, the top 18% in AP Macroeconomics, the top 17% in AP Psychology, the top 14% in AP Art History and the top 10% in Environmental Science.
- GPT-4 is placed within the top 1% of scorers in the USA Biology Olympiad semi-final competition.
Availability of GPT-4
OpenAI is releasing GPT-4’s text input capability via ChatGPT and the API (with a waitlist) from today onwards. To prepare the image input capability for wider availability, OpenAI is collaborating closely with a single partner to start. OpenAI is also open-sourcing OpenAI Evals, our framework for automated evaluation of AI model performance, to allow anyone to report shortcomings in our models to help guide further improvements.
Related Articles
- OpenAI Launches New GPT 3.5 Turbo and Whisper AI Models, 10x Cheaper With Better Results
- Microsoft Bing Has Hit the 100 Million Daily Active Users Milestone
- Microsoft Loosens Bing ChatGPT Limit to 8 Turns Per Conversation, Alongside New Turn Counter Feature
- OnePlus Ace 2V is available for Pre-Order on Giztop
