Senior Software Architect (Remote, EST Time zone) up to 10,000 USD per year. Work 9:00 AM to 5:00 PM Monday Friday. Independent contractor position.

We seek a Senior Software Architect to design and optimize scalable data pipelines and distributed systems. Ideal candidate has extensive AWS and Kafka experience, proficiency in Python, and a strong background in building messaging-driven systems. This role is critical for enhancing our platform architecture and ensuring efficient data processing and integration with vendors.

Key Responsibilities:

• Develop and maintain architectural blueprints for robust data systems.
• Identify and address performance bottlenecks to enhance system efficiency and responsiveness.

• Design and implement scalable data pipelines to support real-time analytics.
• Architect distributed systems capable of handling large-scale data processing.

• Improve existing Kafka-based messaging systems to ensure high throughput and low latency.

• Integrate and manage vendor data feeds and troubleshoot issues related to job feed processing.
• Implement and consume data feeds in various formats, ensuring compatibility and scalability.

• Drive best practices for Elasticsearch/Open Search indexing as part of platform initiatives.

• Provide technical guidance and mentorship to junior team members.
• Collaborate closely with the engineering team to develop new features and enhance site architecture.

Qualifications:

• Proven experience with AWS and Kafka for building scalable data architecture.
• Strong proficiency in Python, with a focus on asynchronous programming.
• Experience with distributed systems and large-scale data pipeline architecture.
• Familiarity with Docker, Postgres, and SQLAlchemy for database management.
• 8+ years of experience in software development, particularly in data pipelines and distributed systems.
• Excellent problem-solving, analytical, and communication skills.

Nice-to-Haves:

• Deep understanding of asynchronous processing in distributed systems.
• Experience with job board integrations and related technologies.
• Knowledge of data warehousing and real-time data processing technologies.