QA Engineer

About us Ruby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our innovative teams are driving the future of consumer-led products, and we're always looking for passionate individuals to join us. Learn more about our story at: https://rubylabs.com/about-us/ About the role At RubyLabs, we're seeking a QA Engineer to own the validation of product experiments from preview to production. You'll work closely with the Growth team to ensure experiments are correctly implemented, accurately tracked, and safe to release. This role goes beyond traditional QA. You will validate experiment logic, user flows, targeting conditions, and analytics accuracy across all variants, ensuring teams can make reliable product decisions based on trustworthy experiment results. Because experiments directly impact product growth and revenue, your work will play a critical role in maintaining product quality and data integrity.

Key Responsibilities

Experiment Validation: Own end-to-end QA validation of experiments from preview environments through production release. Variant Testing: Validate all experiment variants (A/B/C/etc.) and ensure expected behavior across different user scenarios. Targeting & Triggers: Verify audience targeting logic, eligibility rules, and experiment trigger conditions. Analytics Validation: Ensure analytics events, conversions, and experiment metrics are correctly tracked and reported. User Flow Testing: Validate experiment behavior throughout the entire user journey. UI/UX Validation: Ensure experiment implementations meet design requirements and provide a consistent user experience. Production Monitoring: Perform post-release validation using production environments and session replay tools. Edge Case Detection: Identify unexpected behaviors and issues beyond predefined test cases. Regression Prevention: Ensure experiments do not negatively impact core product functionality. QA Sign-Off: Provide clear release recommendations and final QA approval before launch.

Qualifications

Experimentation Experience: Experience testing A/B tests, feature flags, or growth experiments. Analytics Tools: Experience with Mixpanel, Amplitude, or similar analytics platforms. API & Backend Knowledge: Ability to validate API responses and investigate backend-related issues. Session Replay Tools: Experience using session replay or observability platforms for production validation. Startup Experience: Experience working in fast-moving product-led environments. Attention to Detail: Strong ability to identify issues across UI, business logic, and data tracking. Product Thinking: Ability to evaluate features from both a user experience and business perspective. Ownership Mindset: Takes responsibility for the quality and outcome of released experiments. Analytical Thinking: Comfortable investigating complex behaviors and uncovering root causes. Fast-Paced Environment: Ability to manage multiple experiments and priorities simultaneously. Communication Skills: Clear and structured communication with Product, Growth, Design, and Engineering teams. Location Ruby Labs operates within the CET (Central European Time) zone. Applicants from any country are welcome to apply for the position as long as they are located within approximately ± 4 hours of CET. This ensures optimal collaboration and communication during working hours.

Benefits

Discover the perks of being part of our vibrant team!

We offer

Remote Work Environment: Embrace the freedom to work from anywhere, anytime, promoting a healthy work-life balance. Unlimited PTO: Enjoy unlimited paid time off to recharge and prioritize your well-being, without counting days. Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge. Company-provided MacBook: Experience seamless productivity with top-notch Apple MacBooks provided to all employees who need them. Flexible Independent Contractor Agreement: Unlock the benefits of flexibility, autonomy, and entrepreneurial opportunities. Benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere. Read more about it here: https://docs.google.com/document/d/1nkrN76JlZkbKj9WSOhlT1_mni_CZeDkHdwfIjPXVwvk/preview?tab=t.0#heading=h.ndsdl4wapxtt Be part of our fast-growing team and seize this excellent opportunity for personal and professional growth! Interview Process After submitting your application, we conduct a thorough review which typically takes 3 to 5 days, but may occasionally take longer due to the volume of applications received. If we see a potential fit, we proceed with the following steps: Recruiter Screening (40 minutes) Technical Interview (60 minutes) Final Interview (30 minutes) Life at Ruby Labs At Ruby Labs, we move fast, aim high, and expect the same from our team. We’re not here to play small—we’re here to build, grow, and win. That means we look for people who are ambitious, driven, and ready to give their best every single day. This is a place for individuals who thrive under pressure, embrace challenges, and see opportunity in every obstacle. If you’re hungry to achieve, motivated by impact, and want to grow at the speed of your own ambition, Ruby Labs offers the platform to make it happen. Here, effort is matched with reward. We recognize those who go all in and deliver results, and we create space for people who want more—more responsibility, more growth, and more success. #LI-Remote Apply To This Job