Software delivery today demands both speed and quality. Traditional automation tools, though effective in some areas, often stumble when applied to products with unique architectures like Tally. That’s why we created TallyRobot — a purpose-built automation testing framework that understands Tally Prime’s DNA.
It’s not just another automation tool. TallyRobot acts like an AI-powered testing agent, blending precision, adaptability, and intelligence into every test run.
Why TallyRobot is different
1. Custom scripting format
Instead of generic scripting languages, TallyRobot uses a purpose-built scripting format for TDL-based UIs. This ensures automation is tightly aligned with Tally’s interface behavior, making scripts:
- Cleaner
- Faster to write
- Easier to maintain
2. Map File + Keyword driven approach
TallyRobot uses a Map File + Keyword driven structure that enables context-aware navigation.
- Centralized UI map: Scripts don’t hardcode steps but reference a shared map file.
- Context verification: Before executing any keystroke, TallyRobot confirms it’s in the correct UI context.
- Effortless maintenance: If the UI changes, only the map file needs updating — all scripts adapt automatically.
3. One script, Multiple capabilities
TallyRobot eliminates duplication by allowing a single script to validate multiple scenarios, including:
- Remote functionality testing
- Multi-lingual testing
This saves time, ensures consistency, and expands test coverage without additional scripting overhead.
4. Built-in performance testing
TallyRobot isn’t just about functional testing — it also supports dedicated performance testing without needing a separate tool.
The scripter adds perfstart and perfend commands in the script.
Between these markers, TallyRobot captures performance metrics such as:
- CPU usage
- I/O operations
- Execution duration
- CPU time
- Memory usage
This approach makes performance testing lightweight, integrated, and accessible within the same framework.
5. Human-like validation with screen capture
TallyRobot also brings a unique validation capability that mimics how a human tester works:
- Tally screen capture feature: During execution, TallyRobot captures actual Tally product screens.
- Visual validation: These captures are compared against expected screens to confirm correctness.
- Closer to human testing: This approach ensures validation isn’t limited to backend checks — it reflects how a real tester would verify the UI.
Seamless integration with scalable test deployment
TallyRobot integrates with a scalable Jenkins-based deployment model for massive test execution.
Key features of this model:
1. Dev & Production server setup – to streamline the automation lifecycle (Plan → Define → Build → Test → Deploy).
2. Centralized repository (AWS S3) – for versioned test data and results, accessible from anywhere.
3. Scalable server orchestration – auto-deploys multiple Jenkins servers & nodes for heavy workloads.
Intelligent infra deployment –
- Auto-scales test infra (AWS/OCI) based on queue size.
- Chooses alternate instance types on creation failure.
- Self-heals connections with Jenkins servers.
- Auto-terminates idle test infra to save cost.
- System health monitor detects stuck scripts (CPU/memory/disk stalls) and aborts them, so the next script in the queue can continue without delay.
4. Result tags – store project-wise results of the same scripts against multiple baselines.
5. AWS DynamoDB – to store test suite result metadata.
6. AWS Lambda – for baseline lifecycle (creation, viewer, update, rollback).
Impact: With this scalable model, Tally validates 1.3 million test results in a single day.
Smart test results with FailSense AI
Bringing it all together is the Test Result Framework, enabled by our in-house FailSense AI.
- Failure Patterning: Groups failures by common root causes.
- Self-Learning: Learns from past results and validates automatically.
- Insights at a Glance: Highlights recurring failures, reopened issues, false positives, and genuinely new bugs.
- Visual Analysis: Provides diff images, OCR checks, and HTML reports with side-by-side screenshots.
This means testers spend less time triaging noise and more time focusing on real product issues.
Conclusion
TallyRobot is not just automation — it’s a complete intelligent testing ecosystem. From context-aware scripting to built-in performance capture, from scalable deployment to AI-powered failure analysis, Tally has built a framework that ensures every release is fast, reliable, and customer-ready.
With 1.3 million validations a day, Tally’s automation testing is proof that quality and speed can go hand in hand — if you build the right system.
