Data Engineer
Contract
San Francisco, CA
Security
$130,000 - $170,000
Posted 50 days ago
Job Description
Build and maintain the data infrastructure that enables our analytics and machine learning capabilities. You'll design scalable data pipelines, optimize data storage and retrieval, and work closely with data scientists and analysts to ensure reliable access to clean, processed data.
Our data platform processes terabytes of information daily from various sources including user interactions, IoT devices, and third-party APIs. You'll have the opportunity to work with modern data stack technologies and solve complex problems around data quality, performance, and scalability.
Requirements
- 4+ years of experience in data engineering or related field
- Strong proficiency in Python and SQL
- Experience with data pipeline tools (Airflow, Prefect, or similar)
- Knowledge of big data technologies (Spark, Hadoop) and cloud data services
- Familiarity with data warehousing concepts and tools (our company, BigQuery, Redshift)
- Understanding of data modeling and ETL/ELT processes
- Experience with streaming data platforms (Kafka, Kinesis)