We're taking pre-orders for an on-prem inference box built on four Intel Arc Pro B60 — here's exactly what it does

Description and use

<p>Since 10 September, four Intel Arc Pro B60 cards in a tower in Meyrin, Geneva, have been running three language models at once — for our own products first. This week we turned that configuration into something you can put in your own building, and opened pre-orders. This post is the spec sheet with the numbers we actually measured, the part that doesn't scale, and what we are not promising.</p> <h2> The problem it solves </h2> <p>We kept hearing the same sentence from law firms, clinics and fiduciaries in Switzerland: <em>"the cloud is not allowed here."</em> Not "expensive", not "we prefe

Problem

<p>Since 10 September, four Intel Arc Pro B60 cards in a tower in Meyrin, Geneva, have been running three language models at once — for our own products first. This week we turned that configuration into something you can put in your own building, and opened pre-orders. This post is the spec sheet with the numbers we actually measured, the part that doesn't scale, and what we are not promising.</p> <h2> The problem it solves </h2> <p>We kept hearing the same sentence from law firms, clinics and fiduciaries in Switzerland: <em>"the cloud is not allowed here."</em> Not "expensive", not "we prefe

Outcome

<p>Since 10 September, four Intel Arc Pro B60 cards in a tower in Meyrin, Geneva, have been running three language models at once — for our own products first. This week we turned that configuration into something you can put in your own building, and opened pre-orders. This post is the spec sheet with the numbers we actually measured, the part that doesn't scale, and what we are not promising.</p> <h2> The problem it solves </h2> <p>We kept hearing the same sentence from law firms, clinics and fiduciaries in Switzerland: <em>"the cloud is not allowed here."</em> Not "expensive", not "we prefe

Evidence

We're taking pre-orders for an on-prem inference box built on four Intel Arc Pro B60 — here's exactly what it does

Source