Android World Benchmark
FinalRun AI Agent achieves 76.7% success rate on Android World Benchmark, across 116 diverse real-world tasks, setting a new state-of-the-art by beating the previous record.
76.7%
Success Rate
116
Tasks Evaluated
89
Tasks Passed
Leading the World in Mobile Agent
Android World Benchmark Leaderboard
FinalRun76.7%
76.7%
AutoGLM-Mobile (DeepSeek)75.8%
mobile-use74.1%
Mobile-Agent-v3 (Qwen, Alibaba)73.3%
JT-GUIAgent-V2 (ByteDance)67.2%
GUI-Owl-7B66.4%
UI-Venus65.9%
DroidRun63.0%
MobileUse62.9%
Complete Task Results
116 real-world Android tasks tested with our AI agent
89
Tasks Passed
27
Tasks Failed
76.7%
Success Rate
All 116 Tasks
AudioRecorderRecordAudioAudioRecorderRecordAudioWithFileNameBrowserDrawBrowserMazeCameraTakePhotoCameraTakeVideoClockStopWatchPausedVerifyClockStopWatchRunningClockTimerEntryContactsAddContactContactsNewContactDraftExpenseAddMultipleExpenseAddSingleExpenseDeleteMultipleExpenseDeleteMultiple2ExpenseDeleteSingleFilesDeleteFileFilesMoveFileMarkorChangeNoteContentMarkorCreateFolderMarkorCreateNoteMarkorCreateNoteAndSmsMarkorDeleteAllNotesMarkorDeleteNewestNoteMarkorDeleteNoteMarkorMoveNoteMarkorTranscribeReceiptNotesIsTodoNotesMeetingAttendeeCountNotesRecipeIngredientCountNotesTodoItemCountOpenAppTaskEvalOsmAndFavoriteRecipeAddMultipleRecipesRecipeAddMultipleRecipesFromImageRecipeAddMultipleRecipesFromMarkorRecipeAddSingleRecipeRecipeDeleteDuplicateRecipesRecipeDeleteMultipleRecipesRecipeDeleteMultipleRecipesWithNoiseRecipeDeleteSingleRecipeRecipeDeleteSingleWithRecipeWithNoiseRetroCreatePlaylistRetroPlayingQueueRetroSavePlaylistSaveCopyOfReceiptTaskEvalSimpleCalendarAddOneEventSimpleCalendarAddOneEventInTwoWeeksSimpleCalendarAddOneEventRelativeDaySimpleCalendarAddOneEventTomorrowSimpleCalendarAddRepeatingEventSimpleCalendarAnyEventsOnDateSimpleCalendarDeleteEventsSimpleCalendarDeleteOneEventSimpleCalendarEventOnDateAtTimeSimpleCalendarEventsOnDateSimpleCalendarFirstEventAfterStartTimeSimpleCalendarLocationOfEventSimpleCalendarNextEventSimpleCalendarNextMeetingWithPersonSimpleDrawProCreateDrawingSimpleSmsReplySimpleSmsReplyMostRecentSimpleSmsResendSimpleSmsSendSimpleSmsSendClipboardContentSimpleSmsSendReceivedAddressSportsTrackerActivitiesCountForWeekSportsTrackerActivitiesOnDateSportsTrackerActivityDurationSportsTrackerLongestDistanceActivitySportsTrackerTotalDistanceForCategoryOverIntervalSportsTrackerTotalDurationForCategoryThisWeekSystemBluetoothTurnOffSystemBluetoothTurnOffVerifySystemBluetoothTurnOnSystemBluetoothTurnOnVerifySystemBrightnessMinSystemBrightnessMinVerifySystemCopyToClipboardSystemWifiTurnOffSystemWifiTurnOffVerifySystemWifiTurnOnSystemWifiTurnOnVerifyTasksDueOnDateTasksHighPriorityTasksDueOnDateTasksIncompleteTasksOnDateTurnOffWifiAndTurnOnBluetoothTurnOnWifiAndOpenAppBrowserMultiplyExpenseAddMultipleFromGalleryExpenseAddMultipleFromMarkorExpenseDeleteDuplicatesExpenseDeleteDuplicates2MarkorAddNoteHeaderMarkorCreateNoteFromClipboardMarkorEditNoteMarkorMergeNotesMarkorTranscribeVideoOsmAndMarkerOsmAndTrackRecipeAddMultipleRecipesFromMarkor2RecipeDeleteDuplicateRecipes2RecipeDeleteDuplicateRecipes3RecipeDeleteMultipleRecipesWithConstraintRetroPlaylistDurationSimpleCalendarDeleteEventsOnRelativeDaySimpleCalendarEventsInNextWeekSimpleCalendarEventsInTimeRangeSystemBrightnessMaxSystemBrightnessMaxVerifyTasksCompletedTasksForDateTasksDueNextWeekTasksHighPriorityTasksVlcCreatePlaylistVlcCreateTwoPlaylistsPerformance Breakdown by Category
Success rates across different task types and difficulty levels
| Task Category | Easy | Medium | Hard |
|---|---|---|---|
| Complex UI Understanding | 83% | 60% | 57% |
| Data Edit | 91% | 14% | 0% |
| Data Entry | 93% | 70% | 44% |
| Game Playing | 100% | — | — |
| Information Retrieval | 86% | 67% | 33% |
| Math & Counting | 100% | 67% | 67% |
| Memorization | 100% | 100% | 25% |
| Multi-App Operations | 100% | 100% | 33% |
| Parameterized Tasks | 93% | 62% | 56% |
| Repetition | 100% | 40% | 20% |
| Requires Setup | 100% | 33% | 0% |
| Screen Reading | 92% | 100% | 44% |
| Search | 91% | 60% | 67% |
| Transcription | 0% | 50% | 50% |
| Untagged | 80% | 100% | — |
| Verification | 86% | — | — |