About the Role
We are seeking a motivated and detail-oriented Data Engineer to support our team. This role is ideal for candidates with a solid foundational knowledge of computer systems engineering and a passion for growing their skills in big data and cloud technologies. You will be working in a team of data engineering specialists, contributing to the development and maintenance of advanced data pipelines and supporting various analytical initiatives.
Requirements
Responsibilities:
Assist in the development and maintenance of data pipelines using Spark, Scala, PySpark, and Python.
Support the deployment and management of AWS services including EC2, S3, and IAM.
Work with the team to implement and optimize big data processing frameworks such as Hadoop and Spark.
Help with the integration and use of various compute instances for specific data processing needs.
Contribute to the development of tools and algorithms for data analysis and visualization.
Assist in troubleshooting and resolving technical issues related to data pipelines and cloud infrastructure.
Collaborate with team members to ensure efficient data processing and storage solutions.
Participate in team meetings and contribute to project planning and execution.
Requirements:
Bachelor's degree in Data Engineering, Data Science, Computer Science, Information Technology, or a related field.
OR equivalent practical experience.
Basic knowledge of Spark and Hadoop distributed processing frameworks.
Familiarity with AWS services, particularly EC2, S3, and IAM.
Some experience with programming languages such as Scala, PySpark, Python, and SQL.
Understanding of data pipeline development and maintenance.
Strong problem-solving skills and the ability to work collaboratively in a team environment.
Eagerness to learn and grow in the field of data engineering and cloud technologies.
Preferred Qualifications:
Exposure to Databricks Runtime and Spark Livy.
Basic understanding of location data types and spatiotemporal data.
About the Company
Obsidian specializes in technology development and analytic support to global national security objectives. Our dedicated team - rooted in practical national security expertise - is committed to excellence, innovation, and partnership—qualities that make us not just service providers but mission-critical partners to our clients.