Remote Data Engineer needs 10 years experience
Remote Data Engineer requires:
Must be local top Santa Clara
Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically:
BigQuery: Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Programming & Querying:
Python: Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning.
Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar).
DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.
DevOps/CI/CD, Data Pipeline Orchestration:, SQL, Cloud Platform Expertise (GCP Focus):, Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Remote Data Engineer duties:
Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.
Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.
...Minimum Qualifications: Bachelor's degree in Engineering, Information Systems, Computer Science, or related field. Key skills... ...and debugging with JTAG/other tools (required) Understanding of audio technologies, audio software stack, Linux kernel, DSP processing...
...lasting outcomes for our clients, climate and communities. Inclusive culture: Your unique perspective matters. We celebrate diversity... ..., protected veteran status, spouse of a protected veteran, or disability. Stay safe online. Recruitment fraud is on the rise, and Arup...
...Job Summary: The Human ResourcesAssistant supports a wide range of activities inside the HR department, from maintaining employee databases to preparing payroll. An important part of your role will be to act as the liaison between HR and our employees, ensuring smooth...
...AFSCME Council 31 Organizer Based in Chicago, IL AFSCME Council 31 is one of Illinois largest and most active unions, representing over 100,000 active and retired public service workers in over 275 affiliated local unions. Council 31 is a dynamic and progressive...
...Precast Concrete is the nations premier provider of high-quality architectural precast components for a variety of building applications.... ...business growth, we are currently seeking an Architectural Engineer to join our award-winning team. Job Duties: This position...