Remote Data Engineer needs 10 years experience
Remote Data Engineer requires:
Must be local top Santa Clara
Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically:
BigQuery: Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Programming & Querying:
Python: Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning.
Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar).
DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.
DevOps/CI/CD, Data Pipeline Orchestration:, SQL, Cloud Platform Expertise (GCP Focus):, Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub
Remote Data Engineer duties:
Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.
Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.
...Southland Contracting is currently accepting resumes for highly motivated construction workers to join our team as an Excavator Operator . Must be a safe worker and follow all company safety protocols. Duties: Mass Excavation Load Trucks Cut slopes to grade...
We are seeking a hard-working Production Operator to assist in the manufacturing process. The Production Operators responsibilities include maintaining a clean production area, preparing machinery and equipment for use, working on the production line as instructed, and...
...Director of Human Resources Job Description Position Overview The Director of Human Resources (HR) is a key member of the leadership team who will work closely with the VP of Human Resources in overseeing all aspects of the human resources function within the...
...CA is looking for a Licensed Vocational Nurse (LVN) to assume responsibility and accountability... ...Other Licensed Vocational Nurse (LVN) duties as assigned. Qualifications Current... ...for more than 30 years. We offer private duty nursing, skilled nursing, physical rehabilitation...
...sorting information. Compile, verify accuracy, and sort paper-based data. Transfer paper-based data into electronic format in Microsoft Excel. Review data for deficiencies or errors, correct any incompatibilities. Maintain confidence by keeping information confidential...