Published: Thu, 05 Jun 2025 02:50:22 GMT
Position: Senior Software Engineer, Data Acquisition
Company Overview:
People Data Labs (PDL) is a leading provider of people and company data. Our mission is to provide customers with compliant and innovative data solutions by integrating thousands of datasets into a single, developer-friendly source of truth. We are seeking individuals who can demonstrate extreme ownership and a team-oriented mindset to join our Data Engineering & Acquisition Team.
Note: To combat fake applicants and AI-enabled candidate fraud, we have implemented additional measures throughout our hiring process.
Responsibilities:
– Use and develop web crawling technologies to collect and organize data from the internet
– Support and improve our web crawling infrastructure
– Structure, define, and model captured data to ensure high quality and automate data quality monitoring
– Develop new techniques to increase speed, efficiency, scalability, and reliability of web crawls
– Use big data processing platforms to build data pipelines and ensure reliable availability of data
– Collaborate with our data product and engineering team to design and implement new data products and improve existing ones
Requirements:
– 7+ years of industry experience with a strong track record of strategic technical problem solving and implementation
– Strong software development skills for backend applications
– Solid understanding of browser rendering, web application architecture, and programming experience (object-oriented design, asynchronous programming)
– Experience building web crawlers
– Proficient in Linux/Unix command line utilities, system administration, and resource management
– Experience evaluating data quality and maintaining high standards
– Ability to thrive in a fast-paced environment and work independently
– Strong written communication skills
– Experience writing data design documents and scoping projects
– Degree in a quantitative discipline (computer science, mathematics, statistics, engineering) preferred
– Experience as a Red Teamer, working in data acquisition, or network architecture/debugging is a plus
– Experience with Apache Spark, SQL, streaming data platforms, and cloud computing services (AWS, GCP, Azure) is a plus
– Knowledge of modern data design and storage patterns, data warehousing, and data storage formats/tools is a plus
Benefits:
– Stock options
– Competitive salary
– Unlimited paid time off
– Medical, dental, and vision insurance
– Health, fitness, and office stipends
– Ability to work remotely and on your own schedule
– Compensation: $160K – $200K
Equal Opportunity Employer:
People Data Labs is an equal opportunity employer and does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity, or any other reason prohibited by law in provision of employment opportunities and benefits. Applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Personal Privacy Policy for California Residents:
Please refer to our privacy policy and notice for more information on how we handle personal data for California residents. Apply link