Performance Testing
AWS Device Farm
AWS Device Farm is a managed service that provides on-demand access to real Android and iOS devices and desktop browsers for testing mobile and web applications. Teams run automated instrumentation, Appium, or XCUITest suites and manual remote sessions, then receive logs, screenshots, videos, and performance traces in a consolidated report. Its defining operating model is a multi-tenant real-device lab consumed per device-minute.
AWS
Service information
Shortname: Device Farm
Huawei equivalent shortnames: CodeArts PerfTest, CodeArts TestPlan
Keywords: performance, testing, mobile
Differences vs Huawei
AWS Device Farm is a real-device farm for mobile UI and compatibility validation, distinct from CodeArts PerfTest, which is a protocol-level performance and load-testing service targeting HTTP(S) and TCP APIs rather than device-resident apps. There is no Huawei Cloud managed real-device farm of comparable scope; PerfTest exercises back-end endpoints under concurrent virtual users, while Device Farm drives app binaries on physical handsets. Treat them as different workload classes, not interchangeable substitutes.
CodeArts TestPlan is a test-case and test-round management layer (requirements, cases, execution reports, metrics) and does not host devices or generate load. AWS Device Farm's reporting, remote-control, and device-pool management capabilities are core product features, whereas on Huawei the analogous orchestration sits in CodeArts Pipeline, Repo, and TestPlan integrations rather than a single managed device plane. API and data-model boundaries differ: Device Farm exposes schedule/project/run REST resources, while PerfTest exposes task and temp-file resources for load scenarios.
Operational responsibility and scaling differ sharply. Device Farm scale is bounded by AWS device-pool availability and per-run device-selection quotas; Huawei PerfTest scale is bounded by virtual-user concurrency and pressure-engine quotas per region. Device Farm integrates with AWS SDK/CLI and CI via artifacts; PerfTest integrates with CodeArts Pipeline, Repo, and Deploy. Teams migrating should expect a re-architecture of test artifacts, reporting, and pipeline gates, not a feature-for-feature port, and must validate region availability and quotas for the chosen Huawei target.
Migration to Huawei
Begin with a workload assessment that separates mobile-device compatibility testing from back-end performance testing, since no Huawei service provides a managed real-device farm equivalent to AWS Device Farm. Map Appium/XCUITest device suites to a third-party device lab or self-managed device pool on ECS, and reserve CodeArts PerfTest only for HTTP/TCP load scenarios. Confirm target region availability, PerfTest concurrency quotas, and whether CodeArts TestPlan can absorb the test-management metadata you previously tracked in Device Farm.
For device-bound suites, re-host automation on a self-managed Appium grid (ECS or CCE) or a commercial mobile-testing SaaS, and migrate test definitions via source control into CodeArts Repo. Re-author performance scenarios in PerfTest using its script and transaction model; Device Farm remote-access sessions and device-pool artifacts have no direct Huawei target and must be reproduced operationally. Use CodeArts TestPlan to re-create test cases, cycles, and reporting metadata, validating import formats and field mapping before cutover.
Integrate the new targets into CodeArts Pipeline gates mirroring your prior AWS build/release controls, substituting PerfTest tasks for Device Farm run stages and TestPlan quality gates for Device Farm pass/fail reporting. Validate concurrency ceilings, report retention, and IAM equivalence under Huawei identity and access management. Because the migration crosses workload types, run parallel shadow runs and compare coverage, flakiness, and defect-detection rates rather than assuming parity.
Expect a material cost-model change. AWS bills Device Farm by device-minute and slot pack; Huawei PerfTest bills by pressure-engine usage and task duration, while TestPlan is seat- or usage-based. Recalculate TCO using actual concurrency, run frequency, report retention, and any self-managed Appium infrastructure cost. Do not assume savings, and flag the loss of a managed device farm as a residual gap requiring a compensating control or vendor.
Official Huawei Cloud documentation
Huawei Cloud
Huawei equivalent service
Shortname: CodeArts PerfTest
General function: Performance Testing
Performance and load testing service.
Keywords: performance, load test, testing
Huawei equivalent service
Shortname: CodeArts TestPlan
General function: Test Management
Test planning and management service.
Keywords: test management, qa, planning