SlideShare une entreprise Scribd logo
1  sur  27
Acid Test Results UT of Indian Railways Website Presented by: Sarit Arora
The Acid Test  ,[object Object],[object Object],[object Object]
Usability Testing - Method
Usability Testing – irctc.co.in ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Participants  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Accessing www.irctc.co.in None of the test participants opened  www.irctc.co.in  from the search engine results http://www.indianrail.gov.in/ http://www.irctc.com The Reservation links opens www.irctc.co.in in a new browser window.
www.irctc.co.in Some users felt the website did not appear to be associated with Indian Railways. Users expected the Indian Railways logo Users expected atleast one picture depicting a train
Homepage ‘ Train Reservation’ launched a new window with a list of hyperlinks. Users finally resorted to Help but found that the link was “not working”. Other links explored by users. Some users could not make the “connection” between ‘Signup’ and ‘Register’. Login should come after searching the trains, when we want to book Airline booking does not require registration. So why should train booking? The Homepage provided no guidance to what the user must do. Users then explored other links Most users clicked here first as it seemed most obvious link to start searching for trains.
Task 1: Search Trains Home page Task Description Given a date, users were asked to find out if there were any trains to Chennai on that day. Search page View results User’s Mental Model Home page Search page View results Registered User? Login Register Y N Task Flow in the website
Registration - Highlights
Registration  (1) All fields in the form are mandatory Users felt the Registration was too long and cumbersome. Website assumes all users have an ‘Office Address’ Registration often failed due to poor response time. Very lengthy process. Prefer to go to station and book tickets Only advance users can login. Layman would not be able to register Want registration like Yahoo or Gmail, that's easy Users are asked to fill gender, marital status, occupation, etc.
Registration  (2) Users often missed this error message and repeatedly attempted to submit this screen  When informed of the error, users felt the password and confirm password fields should not have been shown.
Search Most users entered city names in the ‘From’ and ‘To’ fields instead of station code. Despite having few fields, the Search feature proved to be a considerable challenge. Even after reading the “definitions”, most users did not know the difference in the Ticket Type. Most selected this randomly as it is mandatory. One interviewee could not spell “Chennai”. Felt the website was not usable. When prompted, users explored other links hoping to find the Station Codes This error message was a major stumbling block. Users has no idea what went wrong.
Selecting the Station Many users felt they had to copy the station name from the list of stations below The field is in fact a filter for City name. I do not understand Station Code. It is irritating to find the code. There is no help in the site. Lack of instructions made simple things confusing to the users.
Search - Highlights
The RIGHT search criteria Field length is not adequate. The station code is “hidden”. The field still contain more than 4 characters.
Task 2: Compare Rates Task Description Given a budget, users were asked to find the best option across trains and classes. “ Best Option” is based purely on the user’s patience in exploring and refining search results Submit search Compare results Select best option User’s Mental Model Select Class  Select train View fare Task Flow in the website Check availability
Search Results Train information should be in tables with cost on same page to compare. Information should be evenly distributed. Lengthy and frustrating. Better to call station master Users felt all of the displayed trains had available tickets. Multiple windows allows me to compare. The result is displayed in ‘Days of the Week’ though the criteria is date based Users are expected to Book Ticket even though no “decision making” information (Fare & Availability) is provided in the results. All such information is distributed among different pop-ups and is not available collectively.
Task 3: Book Tickets Task Description Having identified an option, users were asked to book their ticket. Select Train Book Ticket User’s Mental Model Task Flow in the website Select Train Book Ticket
Booking Form The ticket booking screen continued challenging the users. Options for quota are different from the Search screen Users faced difficulty understanding the terms… “ Select Master passenger” and “ Select passenger from Master list”. ‘ ID Card Holder’ field listed numbers instead of names. This confused the users.
Payment Users did not have an option of going to the list of banks from this screen. Replan takes the user back to the default booking page.
Booking - Highlights
Usability Metrics - Satisfaction Scale 1 - Strongly Disagree 7 - Strongly Agree ,[object Object],[object Object]
Summarizing their experience… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Verdict ,[object Object],[object Object],[object Object]
Contributing Team Members ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Headquarters 410 West Lowe Fairfield, IA 52556  Phone: (800) 242-4480 (641) 472-4480  Fax: (641) 472-5412 B altimore 930 South Wolfe Street Baltimore, Maryland 21231 Tel: (410) 327-1012 / 1013 Fax : (410) 327-1014 Boston 1050 Waltham Street,  Suite 410 Lexington, MA 02421 Tel: (781) 860-7200  Fax: (781) 860-7979 Chicago 8700 W. Bryn Mawr Avenue Suite 800 South Chicago, IL 60631-3507 Tel: (773) 714-2362 Fax: (773) 714-4910 Bangalore, India 310/6 HR Complex, 2nd Floor Koramangala, 5th Block Bangalore 560 095 Tel: +91 (80) 4150 7221/2/3 Fax: +91 (80) 4150 7220 Mumbai, India Unit 7, Shrishti Plaza, Next to Killick Nixxon, Off Saki-Vihar Road, Andheri (E), Mumbai 400072 Tel: +91 22 4017 0400 / 2847 5551 Fax: +91 22 2847 5554 Pondicherry, India Aurelec Premises, Prayogashala Kuilapalayam Village Auroville 605 101 Tel: +91 413 26232 95/96 Fax: +91 413 2623297 Singapore 9 Raffles Place,  Level 58 Republic Plaza,  Singapore 048619 Tel: +65 6823 1368 Fax: +65 6823 1377  China 407, No. 555, Nanjing Road West Shanghai, China 200041 Tel: +86-21-52132061 Fax: +86-21-52132062 Minneapolis 8400 Normandale Lake Blvd,  Suite 920 Minneapolis, MN 55437 Tel: (952) 820-4442 Fax: (952) 921-2306 New York 95 Morton Street Ground Floor New York, NY 10014 Tel: (212) 905-3495 San Francisco 235 Montgomery Street Suite 810 San Francisco, CA 94104 Tel: (415) 765-0962 Fax: (415) 765-0961 London, UK Grosvenor Gardens House 35/37 Grosvenor Gardens London SW1W OBS UK Tel: +44 20 7953 4010 Fax: +44 20 7953 4011 Thank You

Contenu connexe

Dernier

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Dernier (20)

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 

En vedette

Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

En vedette (20)

AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 

World Usability Day - Usability test results

  • 1. Acid Test Results UT of Indian Railways Website Presented by: Sarit Arora
  • 2.
  • 4.
  • 5.
  • 6. Accessing www.irctc.co.in None of the test participants opened www.irctc.co.in from the search engine results http://www.indianrail.gov.in/ http://www.irctc.com The Reservation links opens www.irctc.co.in in a new browser window.
  • 7. www.irctc.co.in Some users felt the website did not appear to be associated with Indian Railways. Users expected the Indian Railways logo Users expected atleast one picture depicting a train
  • 8. Homepage ‘ Train Reservation’ launched a new window with a list of hyperlinks. Users finally resorted to Help but found that the link was “not working”. Other links explored by users. Some users could not make the “connection” between ‘Signup’ and ‘Register’. Login should come after searching the trains, when we want to book Airline booking does not require registration. So why should train booking? The Homepage provided no guidance to what the user must do. Users then explored other links Most users clicked here first as it seemed most obvious link to start searching for trains.
  • 9. Task 1: Search Trains Home page Task Description Given a date, users were asked to find out if there were any trains to Chennai on that day. Search page View results User’s Mental Model Home page Search page View results Registered User? Login Register Y N Task Flow in the website
  • 11. Registration (1) All fields in the form are mandatory Users felt the Registration was too long and cumbersome. Website assumes all users have an ‘Office Address’ Registration often failed due to poor response time. Very lengthy process. Prefer to go to station and book tickets Only advance users can login. Layman would not be able to register Want registration like Yahoo or Gmail, that's easy Users are asked to fill gender, marital status, occupation, etc.
  • 12. Registration (2) Users often missed this error message and repeatedly attempted to submit this screen When informed of the error, users felt the password and confirm password fields should not have been shown.
  • 13. Search Most users entered city names in the ‘From’ and ‘To’ fields instead of station code. Despite having few fields, the Search feature proved to be a considerable challenge. Even after reading the “definitions”, most users did not know the difference in the Ticket Type. Most selected this randomly as it is mandatory. One interviewee could not spell “Chennai”. Felt the website was not usable. When prompted, users explored other links hoping to find the Station Codes This error message was a major stumbling block. Users has no idea what went wrong.
  • 14. Selecting the Station Many users felt they had to copy the station name from the list of stations below The field is in fact a filter for City name. I do not understand Station Code. It is irritating to find the code. There is no help in the site. Lack of instructions made simple things confusing to the users.
  • 16. The RIGHT search criteria Field length is not adequate. The station code is “hidden”. The field still contain more than 4 characters.
  • 17. Task 2: Compare Rates Task Description Given a budget, users were asked to find the best option across trains and classes. “ Best Option” is based purely on the user’s patience in exploring and refining search results Submit search Compare results Select best option User’s Mental Model Select Class Select train View fare Task Flow in the website Check availability
  • 18. Search Results Train information should be in tables with cost on same page to compare. Information should be evenly distributed. Lengthy and frustrating. Better to call station master Users felt all of the displayed trains had available tickets. Multiple windows allows me to compare. The result is displayed in ‘Days of the Week’ though the criteria is date based Users are expected to Book Ticket even though no “decision making” information (Fare & Availability) is provided in the results. All such information is distributed among different pop-ups and is not available collectively.
  • 19. Task 3: Book Tickets Task Description Having identified an option, users were asked to book their ticket. Select Train Book Ticket User’s Mental Model Task Flow in the website Select Train Book Ticket
  • 20. Booking Form The ticket booking screen continued challenging the users. Options for quota are different from the Search screen Users faced difficulty understanding the terms… “ Select Master passenger” and “ Select passenger from Master list”. ‘ ID Card Holder’ field listed numbers instead of names. This confused the users.
  • 21. Payment Users did not have an option of going to the list of banks from this screen. Replan takes the user back to the default booking page.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27. Headquarters 410 West Lowe Fairfield, IA 52556 Phone: (800) 242-4480 (641) 472-4480 Fax: (641) 472-5412 B altimore 930 South Wolfe Street Baltimore, Maryland 21231 Tel: (410) 327-1012 / 1013 Fax : (410) 327-1014 Boston 1050 Waltham Street, Suite 410 Lexington, MA 02421 Tel: (781) 860-7200 Fax: (781) 860-7979 Chicago 8700 W. Bryn Mawr Avenue Suite 800 South Chicago, IL 60631-3507 Tel: (773) 714-2362 Fax: (773) 714-4910 Bangalore, India 310/6 HR Complex, 2nd Floor Koramangala, 5th Block Bangalore 560 095 Tel: +91 (80) 4150 7221/2/3 Fax: +91 (80) 4150 7220 Mumbai, India Unit 7, Shrishti Plaza, Next to Killick Nixxon, Off Saki-Vihar Road, Andheri (E), Mumbai 400072 Tel: +91 22 4017 0400 / 2847 5551 Fax: +91 22 2847 5554 Pondicherry, India Aurelec Premises, Prayogashala Kuilapalayam Village Auroville 605 101 Tel: +91 413 26232 95/96 Fax: +91 413 2623297 Singapore 9 Raffles Place, Level 58 Republic Plaza, Singapore 048619 Tel: +65 6823 1368 Fax: +65 6823 1377 China 407, No. 555, Nanjing Road West Shanghai, China 200041 Tel: +86-21-52132061 Fax: +86-21-52132062 Minneapolis 8400 Normandale Lake Blvd, Suite 920 Minneapolis, MN 55437 Tel: (952) 820-4442 Fax: (952) 921-2306 New York 95 Morton Street Ground Floor New York, NY 10014 Tel: (212) 905-3495 San Francisco 235 Montgomery Street Suite 810 San Francisco, CA 94104 Tel: (415) 765-0962 Fax: (415) 765-0961 London, UK Grosvenor Gardens House 35/37 Grosvenor Gardens London SW1W OBS UK Tel: +44 20 7953 4010 Fax: +44 20 7953 4011 Thank You