DeviQA

BACKGROUND

Please describe your company and position.

I am the VP Engineering of Agorapulse

Describe what your company does in a single sentence.

Agorapulse is a social media management platform that helps businesses schedule, publish, monitor, and report on their social media content across multiple channels from a single unified inbox.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire DeviQA to accomplish?

• Migrate our e2e tests from Cypress to Playwright
• Increase our automated tests coverage
• Stabilize our test suites so that our product teams can rely on them

SOLUTION

How did you find DeviQA?

Online Search

Why did you select DeviQA over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost

How many teammates from DeviQA were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Over the past year, DeviQA’s team has played a key role in strengthening our automated testing strategy and overall product quality. Their primary contribution was the full migration of our end-to-end test suite to Playwright, effectively modernizing our testing stack and improving reliability, execution speed, and maintainability.

Beyond the migration, they significantly expanded both functional and end-to-end test coverage across all major areas of our product. This included identifying critical user journeys, stabilizing existing tests, and continuously adding new scenarios to better reflect real-world usage and edge cases.

As a result of this work, we now run several hundred automated tests twice a day, enabling early detection of regressions and faster feedback loops for our engineering teams. This has materially improved our confidence in releases and our ability to maintain a high level of product quality at scale.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The project delivered several measurable outcomes that clearly demonstrate its success.

First, we achieved a complete migration of our end-to-end test suite to Playwright, resulting in improved test stability, faster execution times, and easier maintenance. One of the most visible improvements is the reliability of our test runs: previously, our test suite was failing multiple times per week, whereas over the past 30 days, we have consistently maintained a success rate above 90%.

Second, functional test coverage increased substantially across all key areas of the product. This broader coverage allows us to detect between 10 and 15 bugs per month before they reach production, significantly reducing production incidents and improving overall product quality.

As a result, we now run several hundred automated tests twice a day, providing continuous and reliable feedback to the engineering team, and enabling earlier detection of regressions.

Finally, the increased level of automation has had a direct impact on team productivity. Product Managers, who were previously heavily involved in manual testing, now save an estimated 6 to 10 hours per week, allowing them to focus more on higher-value activities such as discovery and product strategy.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

DeviQA demonstrated a well-structured and proactive approach to project management throughout the engagement.

We established a regular communication rhythm with weekly video calls to review progress, align on priorities, and address any blockers. In addition, they were integrated into our internal Slack workspace, which enabled smooth day-to-day collaboration. The team provided daily updates on completed work and ongoing tasks, ensuring full transparency and alignment at all times.

In terms of delivery, they consistently met expectations and delivered requested test cases in a timely manner. They showed a good ability to balance priorities between expanding test coverage, improving the existing testing pipeline, and continuously fixing broken or unstable tests. This pragmatic approach ensured steady progress without compromising the stability of the overall test suite.

Overall, they were responsive to our needs, adaptable to changes in priorities, and maintained a reliable pace of delivery throughout the project.

What was your primary form of communication with DeviQA?

Virtual Meeting

What did you find most impressive or unique about this company?

What we found most impressive about DeviQA was their ability to combine strong execution with a genuine ownership mindset.

They did not limit themselves to delivering the requested test cases. Instead, they consistently took the initiative to improve the overall quality of our testing framework. This included proactively identifying gaps in test coverage, suggesting improvements to the existing pipeline, and addressing flaky or unstable tests without waiting for explicit instructions.

Their ability to balance short-term delivery needs with long-term maintainability was particularly valuable. They continuously worked on stabilizing and improving the test suite while expanding coverage, which significantly increased the overall reliability of our testing process.

Finally, their integration within our team was seamless. They operated very much like an extension of our own engineering team, with clear communication, transparency, and a strong commitment to delivering high-quality outcomes.

Are there any areas for improvement or something DeviQA could have done differently?

While the overall collaboration was very positive, there are a few areas where DeviQA could further improve.

Although they did provide reporting and metrics when requested, these were not always as actionable or comprehensive as they could have been. In particular, greater ownership around observability, pipeline stability, and test execution reliability would have been valuable. In practice, part of this effort had to be driven internally.

That said, this remains an area of opportunity rather than a major gap, and it does not detract from the overall quality and impact of their work.

BACKGROUND

Please describe your company and position.

I am the QA Manager of The Mortgage Office

Describe what your company does in a single sentence.

We provide end-to-end loan management software

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire DeviQA to accomplish?

• Migration to Playwright for Test Automation
• Implementation of a Performance Testing framework
• Increased Manual QA Resources

SOLUTION

How did you find DeviQA?

Online Search

Why did you select DeviQA over others?

• Pricing fit our budget
• Good value for cost

How many teammates from DeviQA were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We've been working with Devi QA for our quality assurance needs, and they've made a significant impact on our testing operations and overall product quality.

Services Provided: The team delivered quality assurance, performance testing, and test automation services that addressed critical gaps in our testing infrastructure.

Key Deliverables & Results:

Test Automation Migration: They successfully migrated our entire test automation suite to Playwright, modernizing our approach and significantly improving test reliability and execution speed. The transition was smooth and well-documented.

Performance Testing Framework: They implemented a robust k6 performance testing framework from the ground up. This has given us the ability to proactively identify performance bottlenecks and ensure our application can handle expected load scenarios.

Manual Testing Transformation: Perhaps most impressively, they completely revolutionized our manual testing processes. They introduced structured test case management, improved our bug reporting workflows, and established quality standards that have elevated our entire QA practice.

Impact on Our Team: The engineers from their team are highly skilled, professional, and truly collaborative. They didn't just deliver services—they became an extension of our team, sharing knowledge and helping us build internal capabilities. Our release confidence has increased significantly, and we're catching issues earlier in the development cycle.

I highly recommend Devi QA for any organization looking to strengthen their quality assurance capabilities.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Prior to Devi QA joining our organization, the QA team was seen as a bottleneck for feature throughput. While keeping us lean, they have helped us transform our manual testing process and have contributed to the testing of many important features, increasing our testing capacity by over 230% and eliminating the bottleneck that was slowing our feature delivery.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Devi QA's project management has been excellent. They are outstanding communicators who keep us informed throughout every phase of work. They consistently deliver items on time and meet all agreed-upon deadlines. When we have specific needs or requests, they respond quickly and work collaboratively with us to ensure successful outcomes.

What was your primary form of communication with DeviQA?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The caliber of engineering talent is what impresses me most about DeviQA. Every engineer they've assigned to our project has been top-tier—technically proficient, detail-oriented, and genuinely invested in our success. What's equally remarkable is how quickly they onboard. New resources don't require weeks of ramp-up time; they're productive and contributing to our testing efforts within one week or less. This speaks to both the quality of their team and the effectiveness of their internal processes.

Are there any areas for improvement or something DeviQA could have done differently?

None that I can think of!

BACKGROUND

Please describe your company and position.

I am the Director of Engineering of WoundTech

Describe what your company does in a single sentence.

At WoundTech, our mission is to improve wound healing outcomes and save lives by delivering specialized advanced wound care directly to patients using innovative technology, evidence based wound care pathways, and a proprietary formulary of wound care products. Our focus is on addressing the needs of patience with complex wounds who require timely and effective care.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire DeviQA to accomplish?

• Develop a robust automated test suite
• Build a pipeline for running the suite
• Accelerate our CI process through test automation

SOLUTION

How did you find DeviQA?

Referral

Why did you select DeviQA over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost

How many teammates from DeviQA were assigned to this project?

1 Employee

Describe the scope of work in detail. Please include a summary of key deliverables.

We were provided with a robust test suite using NodeJS of 120+ automated unit and integration tests. The application was built on Playwright.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Number of test delivered stack of lines with architecture unit tests are independent and can be run out of sequence in any order full and end automation with no human interaction required for testing good clean code well organized, and well designed

Describe their project management. Did they deliver items on time? How did they respond to your needs?

This project involved relatively light project management overhead as Alexander the person assigned to the work was predominantly, self managing and very capable. He was able to work in an autonomous fashion.

What was your primary form of communication with DeviQA?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

I really appreciated working with DeviQA. One of the standout aspects was their commitment to using non-proprietary software, allowing us to retain the results of their excellent work. They also brought highly talented professionals to the table. From the moment I met Alexander, I had no doubt he was the right person for the job—capable, skilled, and dedicated. The team was highly professional, delivering exactly what they promised at a very reasonable rate. Their work was impressive, and I would gladly collaborate with them again.

Are there any areas for improvement or something DeviQA could have done differently?

I would have want more time, but unfortunately we have a fixed budget for the project.

BACKGROUND

Please describe your company and position.

I am the QA Chapter Lead of Renhead Technology

Describe what your company does in a single sentence.

We are creating an exceptional HR web application with amazing options for our users.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire DeviQA to accomplish?

• Automation Tests Design
• Automation Tests Execution

SOLUTION

How did you find DeviQA?

Online Search

Why did you select DeviQA over others?

• High ratings
• Good value for cost

How many teammates from DeviQA were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We outsourced automation testers to develop and maintain the automation process for our application. When it comes to the scope of testing, they covered: 

1. feature automation tests - they worked closely with our manual testers to cover the required scenarios for the newly developed features. 
2. smoke automation tests - they worked closely with the QA Lead to cover the essential scenarios that cover our application's key functionalities.
3. regression automation tests - they performed regression tests before each release to speed up the testing process and cover the application as a whole. 

Key deliverables: 

1. test reports

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

1. The percentage of tests that were automated; 
2. The test execution speed; 
3. The testing quality.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Oleg and Eugene were extremely quick to adjust to the changes that were implemented in 2023. for the QA Process. We introduced major improvements that were designed to help with a greater scope of work and they absolutely gave their best effort to fulfill any needs that we had. 
The project needs grew a lot in 2023 so we outsourced another QA Automation Tester (Daria) who was very quick to understand all the project requirements and she delivered exceptionally well. They are all very responsive, dedicated, focused, and patient. it's easy and a pleasure to work with them.

What was your primary form of communication with DeviQA?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Most impressive is how committed they are to satisfying all the requirements we had for them. Also, they are so easy to make plans with, they communicate clearly and make the most difficult challenges we face seem as if they are trivial and easy to overcome.

Are there any areas for improvement or something DeviQA could have done differently?

I can't think of anything that should have been done differently by DeviQA Testers. We made a lot of adjustments and improvements last year and they were very quick to adapt to the changes and benefits are already visible even though we are still at the early stages to see the full benefits.

BACKGROUND

Introduce your business and what you do there.

I’m a QA manager for an advertising technology company; I manage a team of 18. We provide advertising automation tools to customers.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with DeviQA? 

We engaged DeviQA to help resolve our QA process issues. Our goal was to create a simpler QA process to test new features for our web applications.

SOLUTION

What was the scope of their involvement?

We’ve added many new features to our web applications since engaging DeviQA. They’ve been responsible for helping us test the new features, which we’ve built using React, Python, JavaScript, and Scala for machine learning (ML) tools. 

What is the team composition?

We’ve worked with three team members from DeviQA and 10 QA testers. 

How did you come to work with DeviQA?

Our previous CTO found DeviQA through a referral. I wasn’t involved in the process, but they had great reviews on Clutch, so our team initiated the partnership. 

How much have you invested with them?

We’ve invested over $1 million in the partnership with DeviQA. 

What is the status of this engagement?

We contracted DeviQA in June 2019, and the partnership is ongoing. 

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement? 

Our products are complex and ever-changing, so we don’t typically create use cases or track metrics. However, since working with DeviQA, we’ve gradually expanded their responsibilities, and they’ve never missed a deadline. It’s unrealistic to guarantee our application’s success through testing, but the team has done a great job working alongside our customer team to address issues promptly. They’ve helped drive down our average customer response time to less than three hours. 

How did DeviQA perform from a project management standpoint?

We’ve been pleased with how DeviQA has handled our project; they’ve been willing to work late to address various client issues and questions. We’ve used Jira to keep track of tasks and communicated via Slack. We’ve worked with 5–8 QA testers since the beginning of the project, and the rest of the team has worked with us for over two years. 

What did you find most impressive about them?

I’ve been most impressed by DeviQA’s management team. They’ve resolved issues within 24 hours and supported us steadfastly throughout our partnership. During the Russian Invasion of Ukraine, we asked them to supply us with global QA resources, and they immediately identified skilled, qualified candidates. 

Are there any areas they could improve?

I have nothing DeviQA could improve on. 

Do you have any advice for potential customers?

I advise you to communicate your needs with DeviQA and share your feedback. Be as specific as possible when detailing your requirements, and they’ll deliver.

BACKGROUND

Please describe your company and your position there.

I am the VP of Product at CYDEF where we are delivering affordable managed cyber security endpoint detection and response to small and medium businesses.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire DeviQA?

We needed some help and expertise to develop full integration and regression test coverage for our platform and then to have these test plans integrated into our automated DevOps pipelines.

SOLUTION

How did you select this vendor and what were the deciding factors?

I hired this vendor based on their reviews and proven track record of having achieved success on similar projects with our software companies.

Describe the project in detail and walk through the stages of the project.

The project began by breaking down our system into modular components and writing manual test cases to cover all the use cases. Next we began automating the finished test cases. At present we are still developing and creating new content. We are also in the process of integrating finished automated regression and integration test cases into our DevOps Pipelines.

How many resources from the vendor's team worked with you, and what were their positions?

We currently are up to 3 resources from the vendor. All of them work in Quality Assurance either writing and editing test plans, automating test plans and executing test plans.

RESULTS & FEEDBACK

Can you share any outcomes from the project that demonstrate progress or success?

To date, DeviQA has helped us create hundreds of test cases and are fully integrated into our build and release process. We are using them as members of our development team and not as fixed project start-stop resources.

How effective was the workflow between your team and theirs?

The DeviQA resources came up to speed very quickly and work very efficiently with our team. We have virtually seamless integration.

What did you find most impressive or unique about this company?

The company is efficient and understands its core business value. They delivered what they promised and have been excellent to work with.

Are there any areas for improvement or something they could have done differently?

I can say that there is nothing I would change.

BACKGROUND

Introduce your business and what you do there.

We’re a diabetes care and solutions team that’s responsible for developing and operating a global medical platform that connects medical devices and allows patients to share data with healthcare providers and family members. I’m the director of program management, making sure that we implement updates throughout the year on time and at a high level of quality.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with DeviQA?

We brought them on to accelerate our automated testing efforts.

SOLUTION

What was the scope of their involvement?

They helped build something to accelerate the documentation of test results so we could package them for federal compliance documents. 

Our team started with essentially zero automated testing capabilities, intending to ramp up automated testing to about 80% of our product. They worked with us to achieve those benchmarks.  

Since scaling our automated testing, they’ve also come onto our manual testing team. There, they make updates to the framework and scale our capacity to run manual tests.

What is the team composition?

We have five automated testing specialists and six manual testers.

How did you come to work with DeviQA?

Our general manager conducted a web search, and we interviewed 5–6 companies. They asked good questions upfront and could forecast where difficult portions of the scenario would be, able to demonstrate their acumen from the start.

How much have you invested with them?

We’ve spent north of $500,000 to this point. 

What is the status of this engagement?

We started working with them in January 2020 and ramped up the team in October 2020. Our engagement is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Their work has been great. The automated testing framework they developed allows them to respond to changes rapidly and get test results in a timely fashion.

They’ve met our requirements as we’ve requested and overviewed potential process improvements. That’s helped speed up the test execution and provide more data on the output, so we don’t need as much documentation on our side.  

How did DeviQA perform from a project management standpoint?

We’re delegating tasks to their project managers, who are managing their individual teams. Their project management team effectively manages feature builds to ensure that our team isn’t being peppered with questions.

They aggregate updates and information to report back to us as well. Despite being in a different time zone, they’ve always been available when we needed them.  

What did you find most impressive about them?

They treat our automated testing project as a development effort rather than a testing effort, always anticipating next steps and improvements. Whenever we need changes, they’re able to respond quickly. They take on current problems and address future issues as well. 

Are there any areas they could improve?

No, they’re doing great. 

Do you have any advice for potential customers?

Empower them to be in the feedback loop rather than just using them for the test at hand. They can provide feedback and suggestions to benefit the development process.

BACKGROUND

Please describe your company and your position there.

Audio recording, editing, and transcription app QA Manager

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire DeviQA?

DeviQA was brought on board to develop an automation framework and write and maintain tests for our Electron/JS app. Features included STT/TTS, audio file processing, media file compatibility, export formats, text and audio editing, and general UI functions.

What were your goals for this project?

To develop automated test framework for complete feature coverage of UI/functional elements of our application, with the goals of identifying regressions as quickly as possible and keeping pace with new feature development.

SOLUTION

How did you select this vendor?

Deciding factors for selecting DevIQA were their specific skill set and expertise in our tech stack, years of proven experience in leading QA automation efforts, and general knowledge of test automation frameworks and CI integration.

Describe the project in detail.

The scope of our project was to implement and maintain an automated testing framework for our desktop application on an ongoing basis. Technical requirements were CI integration, UI functional testing across media types, formats, upload/download, text and audio editing, authentication workflows. I joined the company after DeviQA stated working with us, and we eventually made the decision to adapt our QA model to in-house.

Regardless, I worked with them for 3 months in a management capacity, depending on their team for nightly test builds and results, bug reports, and fast turnaround on regression testing. The DeviQA team was responsible for following new features and code changes made in our repos and quickly automating test cases and ensuring test coverage for new and existing features. They were in charge of test case organization, designing and implementing the testing framework, and integrating it with our CI system (Jenkins).

What was the team composition?

The team was 2 members, who were both test automation engineers.

RESULTS & FEEDBACK

Can you share any outcomes from the project that demonstrate progress or success?

DevIQA engineers were experts in Javascript test libraries and tools, and designed a framework that was easy to maintain and integrated well with the application services.

How effective was the workflow between your team and theirs?

DevIQA was consistently available via slack and video chat when needed with flexible hours that worked for our engineering team. We held weekly meetings on goals and progress, and they provided daily status updates. Their communication was clear and straight forward, and they could be relied on to respond swiftly to urgent or overnight requests.

Administrative overhead was minimal, as they were able to actively review and engage with ongoing feature development in our repos to add or update new tests. The DeviQA team was self-structured and self-driven, submitting updates and new code on a daily basis. If changes were needed to the existing plan or workflow, they were able and willing to adapt immediately.

What did you find most impressive about this company?

DeviQA had deep experience in javascript and test frameworks, and were able to develop a custom framework that included a number of tools selected carefully for reliable performance, CI integration, depth of reporting capabilities, and lightweight integration into an existing app repo.

The test suite they created was exhaustive and wide-spanning, and their ability to continue updating it with the latest delivered features was impressive. It was a pleasure to work with them and we would recommend them as test automation experts.

Are there any areas for improvement?

No

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a financial firm. We are a private equity investor that has been in business since 1976. We have an extensive portfolio of businesses and assets spanning real estate, high tech, healthcare, retail, and other areas.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with DeviQA?

We had multifold problems finding and retaining good-quality QA and development resources. It is a pretty commonplace problem, particularly in Western Europe, and particularly magnified in the cities where there’s a large financial services sector. We are headquartered in London, which is possibly still the largest financial center in Europe.

SOLUTION

What was the scope of their involvement?

They’ve helped us on two, soon to be three, projects, in addition to helping us with raw development capabilities. We’ve used their test architects, test engineers, and some of the manual testing resources to bring our products to life. They have a fairly large team of on-demand developers, and some have been with us for over 12 months at this point. They also have wide-ranging skillsets in front- and backend technologies.

On the QA side, they’ve been responsible for scoping out, building, and running a fairly sophisticated automation platform for two of the companies in our portfolio. Effectively taking the project from end to end, they’ve helped with everything from the architecture phases to the operation of the automated QA testing.

What is the team composition?

We’ve had between 7–10 resources at the most extreme time. Currently, we have four or five people.

How did you come to work with DeviQA?

Finding people who are highly skilled, motivated, and affordable is incredibly difficult, and we had to cast our net further and further east. The owner of DeviQA had been in touch with me and was very respectful. He would approach me asking if I had any requirements, and even though I didn’t have anything at that time, I asked him to send me a message in three months. That process went on for about nine months. One day, I found that I needed him quite urgently, and he was there for me.

How much have you invested in them?

To date, we’ve spent around $500,000, and that number is going up every month as we continue to draw on their resources.

What is the status of this engagement?

We began working with them in September 2018, and the work is still ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Because it has all been greenfield development, the best way to measure deliverables is how quickly you are getting product out of the door and delivered to the market. With what they have been doing, particularly on the full-cycle test and automated testing, they have done everything we have asked them to do on time and within budget. I think that is a good success marker. If you were to look at financial KPIs, we’ve never blown our budget with them, and they have always delivered when they said they were going to.

Sometimes in an outsourcing relationship, things go wrong. People can get sick, go on holiday— all of the usual stuff. Even making allowances for all of that, they have always done what they said they were going to do. At times when something looked like it was going to go off the rails, they threw their own resources at it for no cost to get back on track.

How did DeviQA perform from a project management standpoint?

They have been super reliable, responsive, and professional through our entire engagement. I keep giving them more work, which I think is always a pretty good indicator of how successful your relationship with the company is.

They were very good, but we never found ourselves having to stress any of their capabilities in that area. Their resources were working under our product and project leads.

What did you find most impressive about them?

They’re focused on delivering incredibly high quality. They don’t complain, and they do exactly what they know needs to be done. In a time-pressed environment, you can’t ask for more than that.

They’re also good at challenging us. They don’t do stuff because you tell them to do it; they will challenge it, acknowledge we want something done in a certain way, but will still suggest other ways to do it. That level of challenge is good.

Are there any areas they could improve?

I’ll say the same thing I would say about any outsourced relationship: communication. You always have to be on the front foot on that, but I know for a fact that it isn’t unique to them because I run several outsourced relationships. Given that they are a remote resource, they really try hard to make it feel like you are in the same room as them.

Do you have any advice for potential customers?

Make sure you have a really clear idea of what you are trying to do. Articulate that upfront rather than making it up as you go along. I think these guys thrive on having structure. Equally, if you can’t do that because of project timing, you can still work with them, but to get the most out of them, give them some structure.