Big Data Engineer Professional Services

Join BrightEdge as a Big Data Engineer and Shape the Future of SEO!

Are you passionate about leveraging the power of Big Data to drive real business impact? BrightEdge, the industry-leading SEO and content performance marketing platform, is seeking a talented and driven Big Data Engineer to join our dynamic Professional Services team. We transform online content into measurable business outcomes by harnessing the power of massive data processing. If you’re ready to tackle challenging problems and contribute to a cutting-edge platform, this is the opportunity for you!

Your Mission: Architecting High-Performance Data Pipelines

As a Big Data Engineer at BrightEdge, you’ll play a pivotal role in designing, building, and maintaining the high-performance data pipelines that power our platform. You’ll be responsible for optimizing existing systems, identifying and resolving performance bottlenecks, and implementing innovative solutions that enhance the overall efficiency and scalability of our infrastructure. Your work will directly impact our ability to process terabytes of data while maintaining exceptional performance.

What You’ll Do:

• Design and implement scalable batch processing systems using Python and Big Data technologies like Spark and Hadoop.
• Optimize database performance, focusing on query optimization and latency reduction.
• Utilize Python profilers and performance monitoring tools to pinpoint and resolve bottlenecks.
• Build efficient ETL pipelines that can handle large-scale data processing with ease.
• Collaborate closely with data scientists and product teams to deeply understand their data requirements and translate them into robust solutions.
• Monitor and troubleshoot data pipeline issues in production, ensuring data integrity and availability.
• Implement rigorous data quality checks and validation mechanisms to maintain data accuracy.
• Document data architecture and engineering processes, promoting knowledge sharing and collaboration.
• Stay abreast of emerging Big Data technologies and best practices, continuously improving our platform.

What You’ll Bring:

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 4+ years of hands-on experience in Data Engineering roles.
• Strong proficiency in Python programming, particularly with data processing libraries.
• Proven experience with Big Data technologies such as Spark and Hadoop.
• Demonstrated ability to optimize database performance (SQL or NoSQL).
• Familiarity with data pipeline orchestration tools like Airflow or Luigi.
• A solid understanding of performance optimization techniques and profiling tools.

Bonus Points:

• Master’s degree in Computer Science or a related field.
• Experience working with SEO data or web crawling systems.
• Familiarity with Clickhouse Database.
• Knowledge of distributed systems and microservices architecture.
• Experience with container orchestration platforms like Kubernetes and Docker.
• Experience with real-time data processing.
• Contributions to open-source projects.
• Experience with machine learning operations (MLOps).

At BrightEdge, you’ll find a supportive and collaborative environment where your contributions are valued and your growth is encouraged. We offer competitive compensation, excellent benefits, and the opportunity to work alongside a team of passionate and talented individuals. We believe in the importance of recognizing hard work, and you will find this job both challenging and financially REWARDing.

To show you’ve read the entire job description, please include RMTk4LjU0LjExNC41NA== (#RMTk4LjU0LjExNC41NA==) when applying. We look forward to hearing from you!

“