Job Priority

Materialized’s Batch API allows you to specify a priority for each job you create. For now, only two priorities are supported: 0 and 1.

Priority 0 (Prototyping)

Priority 0 is the default priority, and is primarily meant for prototyping jobs. You can expect them to complete in a few minutes at most. These are currently soft-limited to 1000 inputs. Please reach out to us at team@materialized.dev if you need to increase this limit.

Priority 1 (Production)

Priority 1 is currently reserved for production jobs. You can generally expect these jobs to take longer; completion times are dependent on the number of inputs, the model being used, and other factors. Generally speaking you can expect these jobs to take roughly one hour to complete.

If you plan to submit a job with more than 1 million inputs or more than 100 million tokens, please reach out to make sure you have the necessary quota.

In the future, we’ll be expanding the number of priority levels available to better serve different cost and speed requirements.