Scale up Apache Spark with Native Compilation
and set your Data on Fire!

We're now accepting applications for our private beta program.

Set your Data on Fire

Flare is a drop-in accelerator for Apache Spark 2.0 that achieves order of magnitude speedups on DataFrame and SQL workloads.

Blog Posts

Parquet on Fire
April 14, 2017

Heterogeneous Workloads and UDFs
April 10, 2017

Flare White Paper
March 24, 2017

Spark Summit EU
November 12, 2016

NUMA-Aware Parallelization
October 26, 2016

TPC-H On a Single Core
October 19, 2016

Spark is Fast, but how Fast?
September 30, 2016

Native Compilation

Spark performance has made impressive progress thanks to Catalyst and Tungsten, but there is still a significant gap towards best-of-breed query engines or hand-written low-level C code.

Flare closes this gap by compiling Catalyst query plans to native code.

Mechanical Sympathy

Flareā€™s low-level implementation takes full advantage of native execution, using techniques such as NUMA-aware data layout and scheduling to leverage mechanical sympathy, and to bring execution closer to the metal than what is possible with current JVM-based techniques.

Big Memory and Many Cores

Modern server-class hardware provides memory in the TB range, and dozens of CPU cores. Such powerful machines are readily available, for example as X1 instances on Amazon EC2 or for purchase at Dell.

They are as powerful as a small cluster, but do not require network communication or fault tolerance, and they consume less energy, which makes them cheaper to operate.

While Spark was primarily designed for scaling out on clusters, Flare makes scaling up on server-class hardware an attractive alternative, in terms of performance, and also in terms of operating costs.


Flare is under active development, and we will continue to share information on our blog and on Twitter.

We are currently running a private beta program: If you are interested in using Flare, please use the contact form below.

Get in Touch

Follow us on Twitter:

Sign up for news via email, or apply for our private beta:

Don't Miss our Upcoming Talks:

Spark Summit 2017, San Francisco, June 6, 3:20 PM

Scala Days 2016, Chicago, April 20, 11:35 AM

Video Recordings of Past Presentations:

Spark Summit EU 2016, Brussels, October 26, 4:05 PM (video)