job_etl

Stores extract-transform-load (ETL) related jobs. Specifically this means csvloader and extractor right now.

Primary Key:

• job_etl_id

Checks:

• job_etl_job_type_check - (job_type = ANY (ARRAY['csvloader'::claims.job_type, 'extractor'::claims.job_type]))
• job_etl_parent_id_check - ((job_type = 'csvloader'::claims.job_type) = (parent_id IS NOT NULL))
• job_etl_status_check - ((status = ANY (ARRAY['succeeded'::claims.job_status_type, 'failed'::claims.job_status_type, 'cancelled'::claims.job_status_type, 'skipped'::claims.job_status_type])) = (job_end IS NOT NULL))

Foreign Keys:

• parent_id => job_etl.job_etl_id

Indexes:

• job_etl_parent_id_idx - parent_id

Column	Data Type	Nullable	Indexed	Description
job_etl_id	bigint	No	Yes	Snowflake ID for job_etl primary key.
parent_id	bigint	Yes	Yes	Optional link to a parent job. Used so a csvloader job can reference the extractor job that produced its input.
job_type	job_type	No	No	The type of job. This is usually the name of a service running the job (e.g. extractor, csvloader, exporter).
name	text	No	No	Name for the job. Comes from the zipName in extractor/csvloader config.
input_filename	text	No	No	Filename of the input being processed by this job.
release_start_date	date	Yes	No	Start of the release-date range covered by this input. One of release_*_date or version must be set.
release_end_date	date	Yes	No	End of the release-date range covered by this input. One of release_*_date or version must be set.
version	text	Yes	No	Version of the input filename. One of release_*_date or version must be set.
job_start	timestamp with time zone	No	No	Time this attempt started.
job_end	timestamp with time zone	Yes	No	Time this attempt finished. NULL while the attempt is still in progress.
status	job_status_type	No	No	Status of this attempt (e.g. queued, running, succeeded, failed, cancelled, skipped).
job_metadata	jsonb	No	No	Additional metadata describing what the attempt did (e.g. archive_filename, extractor_input_version_id, and anything else useful for understanding what was done and how).
log	text	No	No	Logs captured from this attempt.