Volume Performance Testing of a Warehouse Execution System

A Case Study

Context

  • The customer had a Warehouse Execution System (WES) deployed with end customers who own distribution centers and warehouses. The WES effectively moves material to manage the inbound and outbound logistics.
  • WES orchestrates equipment and people inside the warehouse by allocating specific tasks when an order is received. The equipment includes scanners, cranes, robots, and conveyor belts.
  • A warehouse deployment has specific layouts with different configurations of zones and devices. It is expected to have a defined throughput within milliseconds.
  • The system must be tested for various end-customer configurations for every new implementation and continuously enhance the base platform. Volume performance tests need to be executed for many days and weeks.

Before Doppelio

  • The client developed warehouse simulations using JMeter. Customer requirement-based simulation scenarios were developed for a particular release.
  • The JMeter performance engineering team spent a lot of time developing flows with a lot of constraints. 
  • Handled various asynchronous protocols using different JMeter plugins and libraries introduced performance bottlenecks
  • The reactive nature of the system needed exceptionally highly skilled developers to code, debug, and maintain the flows.
  • Running the flows in multiple nodes across various test environments in parallel over weeks was a significant challenge. The flow simulators slowed down and crashed over time, and continuous tweaking was needed to make it work.
  • Lack of comprehensive coverage in testing the scenarios
  • Uncertain project timelines due to uncertain execution

With Doppelio

  • Programmed (in low code) asynchronous implementations within hours.
  • Rapidly created various doppels, such as crane, user, and scanner doppel, and orchestrated them for different warehouse configurations. These components talk to each other and the WES to achieve the simulation goal.
  • The team could come up with complex reactive flows quickly as the development team updates the design.
  • Domain experts could manage the testing without dependency on highly skilled JMeter flow developers.
  • Ran tests for weeks across multiple test environments without worrying about slowing down/crashing simulators.
  • Met all the deadlines with comprehensive testing.

Doppelio Impact

No dependency on skilled JMeter performance engineering team.

Met all the deadlines with comprehensive testing.

Successful tests are run without crashes or slowdowns in simulators.

View More Success Stories on IoT Testing

Get to know more about how we’ve solved diverse challenges when it comes to IoT Testing.