Software Engineer - Open Source Intelligence Solutions

Overview Join us at the forefront of technological innovation in the realm of Open Source Intelligence (OSINT). Our company specializes in gathering, analyzing, and deploying data derived from publicly available sources to empower decision-makers across various industries. We leverage cutting-edge technologies and methodologies to transform unstructured data into actionable insights, helping our clients navigate complex environments with precision and foresight. Essential Job Duties Strategic Data Engineering: Design and implement robust data scraping engines to capture and curate information from diverse web sources. Utilize advanced web scraping techniques and API integrations to enhance our data acquisition capabilities. Workflow Automation & Optimization: Develop and refine orchestration workflows using Apache Airflow, ensuring efficient and scalable data processing pipelines. Collaborate with the engineering team to integrate these solutions into our comprehensive OSINT platform. Advanced Data Operations: Engage in sophisticated data cleaning and classification tasks. Apply your expertise in Python and test-driven development to automate and optimize processes for each unique data source. Collaborative Development: Work closely with data analysts to identify and integrate new information sources based on client needs. Contribute to a collaborative codebase, utilizing Git for version control and participating in our agile development cycles. Problem Solving & Innovation: Proactively identify and resolve issues within the platform, enhancing functionality and user experience. Participate in daily standups and agile processes to continuously advance project goals. Minimum Requirements Expertise in Core Technologies: Extensive knowledge of Python, with practical experience in Docker and Kubernetes. Familiarity with test-driven development and a strong command of software engineering best practices. Technical Acumen: Solid understanding of web technologies, APIs, and modern data aggregation methods. Experience with Elasticsearch, Apache Nifi, and SOLR is desirable. Professional Experience: Proven track record in a similar role within tech-driven, fast-paced environments. Experience with agile development methodologies and a proactive approach to problem-solving. Passion for data: A fervent interest in exploring and innovating within the open source intelligence domain, driven by a desire to make a significant impact on data-driven decision-making processes. Preferred Qualifications Government Security Clearance. Work Environment Working conditions are normal for an office environment. Fast paced, deadline-oriented environment. SOSi is an equal employment opportunity and affirmative action employer. All interested individuals will receive consideration and will not be discriminated against on the basis of race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, or protected veteran status. SOSi takes affirmative action in support of its policy to advance diversity and inclusion of qualified individuals who are minorities, women, protected veterans, and individuals with disabilities.