OpenAI's finance AI scores 69.9%. Build a 50-question eval harness for your own documents.

Description and use

<p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" alt=" " width="800" height="447"></a><br> ChatGPT for Financial Services arrived on 10 September with a benchmark score attached:

Problem

<p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" alt=" " width="800" height="447"></a><br> ChatGPT for Financial Services arrived on 10 September with a benchmark score attached:

Outcome

<p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fabxgcc945iu1uogw5hj2.png" alt=" " width="800" height="447"></a><br> ChatGPT for Financial Services arrived on 10 September with a benchmark score attached:

Evidence

OpenAI's finance AI scores 69.9%. Build a 50-question eval harness for your own documents.

Source