Remote jobs in Programming

WORK ANYWHERE!

SemanticBits

Senior Data Engineer (Scala/Spark)

USA

scala

devops

python

big data

hadoop

aws

4 months

Remote Jobs

>

Remote Jobs in USA

>

Senior Data Engineer (Scala/Spark)

Location: USA Type: Full-time

Position Summary


SemanticBits is looking for a talented Data Engineer who is eager to apply computer science, software engineering, databases, and distributed/parallel processing frameworks to prepare big data for the use of data analysts and data scientists. 


You will use Spark to build data processing pipelines that derive information from large sets of government data. You will be a subject matter expert for Spark, the Spark Engine, and the Spark Dataframe API. You will use their knowledge of Spark to teach others, inform design decisions, and debug runtime problems.


Tools & Technology



  • Spark, Hadoop, Scala, Python, and AWS EMR

  • Jupyter and Zeppelin

  • Airflow, Jenkins, and AWS Step Functions

  • AWS S3, AWS Redshift, and Teradata

  • GSuite, Slack, Jira, Confluence, Git, and Github


Responsibilities



  • Build scalable data processing pipelines in Spark

  • Debug Spark jobs and do performance tuning

  • Write unit and integration tests for all data processing code

  • Work with DevOps engineers on CI, CD, and IaC

  • Read specs and translate them into code and design documents

  • Perform code reviews and develop processes for improving code quality


Required Qualifications:



  • Highly Competent with Scala, Spark, the Spark Engine, and the Spark Dataframe API

  • Experience with Agile methodology, using test-driven development.

  • Excellent command of written and spoken English



  • Candidate must reside in the United States



  • Bachelor's degree in Computer Science strongly preferred and a minimum of 5 years of relevant experience or a Master’s degree with a minimum of 3 years experience



  • Flexible and willing to accept a change in priorities as necessary





Physical and emotional requirements for the job:


This position is to be performed remotely from an individual’s home office and involves sedentary work. Employees in this role can be expected to exert up to 10 pounds of force on occasion in order to lift, carry, push, pull or otherwise move standard electronic equipment. Employees are expected to make decisions in a timely manner and display emotional intelligence during occasional stressful situations. 





Benefits:



  • Generous salary

  • Three weeks of PTO

  • Excellent health benefits program (Medical, dental and vision)

  • 401k retirement plan. We contribute 3% of base salary irrespective of employee's contribution

  • 100% paid short-term and long-term disability

  • 100% paid life insurance

  • FSA

  • Casual working environment

  • Flexible office hours


SemanticBits, LLC is an equal opportunity, affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other characteristic protected by law. We are also a veteran-friendly employer.

Your DREAM REMOTE JOB inside your inbox!

Get a
email of all new remote
Jobs.

Cookies, terms, and privacy policy

By clicking or navigating this website you accept and allow all our cookies, terms of use and privacy policy. This site uses cookies to offer you a better browsing experience.

UNDERSTOOD
feedbackfeedback

How would you rate your experience?

Experince

We may wish to follow up. Enter your email if you're happy for us to contact you.