Remote jobs in Programming

WORK ANYWHERE!

Bradford & Galt

Cloud Data Engineer

USA

cloud

python

big data

sql

architecture

1 week

Remote Jobs

>

Remote Jobs in USA

>

Cloud Data Engineer

Location: USA Type: Full-time

*Remote is fine*


The Cloud Data Engineer will develop and support data-driven applications in the cloud. The Data Engineer will work as a part of a cross-functional team that creates well architected solutions that solve difficult business problems quickly, yet completely. This individual will be involved in application design and development from conceptualization through execution, deployment and sustainment using Google Cloud Platform - GCP. The right candidate will be excited by the prospect of optimizing or even re-designing our company's data architecture to support our next generation of applications and data initiatives.

Responsibilities

  • Develop optimal extract, load and transform pipelines from a wide variety of data sources using Python and Spark
  • Utilize GCP 'big data' technologies like Cloud Dataproc and BigQuery
  • Schedule and orchestrate solutions using GCP Cloud Composer
  • Create real-time data streaming pipelines using GCP App Engine and Dataflow
  • Perform data exploration in support of new projects and to troubleshoot issues
  • Work closely with data analysts to facilitate data acquisition and enable efficient analysis
  • Adapt existing batch and real time data pipelines to accommodate new business requirements
  • Develop and deploy code with exception handling, logging and monitoring
  • Ensure data quality throughout the entire data processing pipeline
  • Perform unit testing, integration testing, and assist with user acceptance testing


EXPERIENCE BASE/BACKGROUND

  • Bachelor's Degree in computer science or equivalent experience required
  • 3+ years hands on experience with Python
  • 3+ years hands on SQL and relational database experience
  • 2+ years hands on experience in a public cloud development environment (GCP preferred)
  • Experience setting standards for design, documentation, testing, and code quality
  • Proficient understanding of distributed computing principles
  • Preferred: Experience with messaging systems, such as Kafka and GCP PubSub


Can be remote



Bradford & Galt is an equal opportunity employer. We will not discriminate, and will take affirmative action measures to ensure against discrimination in employment, recruitment, advertisements for employment, compensation, termination, and other conditions of employment, against any employee or job applicant on the basis of race, color, gender, national origin, age, religion, creed, disability, veteran's status, or sexual orientation.

Your DREAM REMOTE JOB inside your inbox!

Get a
email of all new remote
Jobs.

Cookies, terms, and privacy policy

By clicking or navigating this website you accept and allow all our cookies, terms of use and privacy policy. This site uses cookies to offer you a better browsing experience.

UNDERSTOOD
feedbackfeedback

How would you rate your experience?

Experince

We may wish to follow up. Enter your email if you're happy for us to contact you.