Black-spots on rails: commuters forced to look out of the window as up to 1 in 3 mobile internet tasks attempted on trains fail

Three crowned best network for commuters who like to talk, Vodafone for commuters on 3G, and EE for commuters on 4G, following most rigorous train connectivity study ever conducted

  • 1 in 3 mobile internet tasks and 1 in 7 voice calls attempted on commuter train routes failed during testing
  • Three has best network for commuters who like to talk
  • Vodafone’s subscribers get best 3G data service, EE subscribers best 4G data service…
  • …but EE, O2, and Vodafone all heavily relying on their older 2G networks to cover commuters
  • St. Pancras wins mobile connectivity wooden spoon

OCTOBER 14, 2014 - LONDON, UK — Almost a third of mobile internet tasks (30.3%) attempted on commuter train routes failed during a connectivity study carried out by Global Wireless Solutions (GWS).

GWS engineers carried out high-level tests while travelling back and forth on the ten most popular commuting routes into and out of London, and discovered that—on average—almost 1 in 4 3G data ‘packets’ (23.2%), and well over 1 in 3 4G data packets (37.2%) travelling across the networks of the four major UK operators didn’t make it to their intended destinations.

Figure 1: Packet data reliability: the big four operators on 3G and 4G

Data Type 3 EE O2 VODAFONE
3G 77.4% 69.8% 78.0% 82.0%
4G 35.4% 74.1% 65.9% 75.1%

GWS’ testing suggests that Vodafone subscribers get the best 3G data service while commuting – Vodafone’s 3G network is the most reliable (in terms of getting data packets through) and offers the fastest download speeds (2Mbps on average during testing).

EE currently offers the best 4G data service; its 4G network tied with Vodafone in the reliability stakes but was the fastest when it came to downloads (5.6Mbps on average during testing).

Figure 2: how long it is likely to take commuters with 3G data to upload a picture/download a song/download a video?

Task 3 EE O2 VODAFONE
Time to upload 4MB picture (seconds): 33 36.2 45.4 48.4
Time to download 4MB song (seconds): 23.3 21 26.8 16.1
Download time for 4 minutes of HD video (seconds): 41.2 42.4 46.8 41.5

Figure 3: how long it is likely to take commuters with 4G data to upload a picture/download a song/download a video?

Task 3 EE O2 VODAFONE
Time to upload 4MB picture (seconds): 16.3 10.8 16.3 9.5
Time to download 4MB song (seconds): 10.8 5.8 7.1 7.7
Download time for 4 minutes of HD video (seconds): 16.2 7.8 11.2 12.4

Every carriage is a quiet carriage now

GWS’ testing suggests that it’s not just the mobile internet that Londoners struggle to use while commuting: 1 in 7 voice calls (14%) made from trains fail too.

Three won GWS’ voice calling run-off; its network was the joint-first-most reliable, but emerged as the clear winner when call quality was factored in.

Commuters are likely to experience poor call quality (e.g. sound breaking up) when mobile operators use older 2G networks to route their calls, and/or use ‘half-rate codecs’ to decode voice call data.

GWS’ engineers were ‘on 2G’ with O2 for more than 60% of the time while testing on commuter trains. In addition, O2 used half-rate codecs to handle almost a third of all the calls (28.16%) engineers made during the testing programme.

EE fell back on its 2G network two-fifths of the time (41.82%) during testing, but only used half-rate codecs to decode 2.96% of the test calls made.

Vodafone also relied on its 2G network 40% of the time during testing; it used half-rate codecs to decode 7.92% of all the calls made by engineers in the course of the testing programme.

No signal on the Hogwarts Express

1 in 4 of the data task failures (24.18%) GWS’ engineers experienced occurred while they were on trains in stations, while 1 in 5 occurred when they were on trains on open stretches of track.

However, voice calls are more likely to fail on open track than in a station (1 in 4 of the voice ‘failures’ GWS’ engineers experienced occurred when they were in a station, compared to 1 in 3 when they were on open track).

GWS found that voice and data failures are more likely to occur when a train is travelling from 0-5 MPH than when it is travelling between speeds of 5 and 50 MPH. Failures are most likely to occur when a train is travelling above 50 MPH.

St. Pancras has by far and away the worst connectivity of all of the stations tested by GWS. GWS’ engineers experienced an average of 99 voice and packet data failures (across the four operators) while testing in the famous station.

Figure 4: Top 10 worst-connected commuter stations

Ranking (worst to best) Station Average number of Voice and data failures
1 St. Pancras 99
2 Radlett 53
3 Kentish Town 43
4 Upminster 42
5 Elstree and Borehamwood 36
6 Hendon 33.5
7 St. Alban’s City 33
8 Cricklewood 27.5
9 Kidbrooke 27
10 Ockendon 26

Paul Carter, CEO of GWS, commented: “Leaves on the track, the wrong kind of snow, having to stand up all the way to work and back – commuters have enough to contend with without the kind of mobile connectivity problems we’re revealing today. It’s hard to believe we’re in 2014 and in a situation whereby a trained wizard would have a tough time getting a signal on the Hogwarts Express while it’s sitting in St. Pancras.”

“Pressure from commuters makes it inevitable that trains won’t keep their status as mobile dead zones for much longer. It’d be great to see networks, rail operators and station-masters taking the lead on improving connectivity for commuters – rather than having to be dragged into the 21st Century kicking and screaming.”

Methodology

GWS’ engineers benchmarked the ten most popular commuter train routes into and out of London, and used an array of 12 Samsung Galaxy S4s (powered by Rohde & Schwarz’s SwissQual QualiPoc Freerider) to gather data for its study of commuters’ mobile connectivity. Three SIMs from each of the four major UK operators (3, EE, O2 and Vodafone) were used during testing – in each case one SIM was used for voice testing, one SIM was used for 3G-only data testing, and one SIM was used for 4G-only data testing. An extremely wide range of voice and data metrics were analysed during the study of commuters’ connectivity experiences; a specific rundown of these metrics is available on demand. The figures posted have been weighted and stat-tested. Testing was conducted in June 2014.

About Global Wireless Solutions, Inc.

Global Wireless Solutions, Inc. (www.gwsolutions.com) defines the industry standard for network benchmarking, analysis and testing. Working with some of the world’s largest wireless network providers, Global Wireless Solutions offers standardized, high-quality network data and engineering analysis to its customers through a suite of benchmarking products, including drive testing, in-building testing and App testing.

Firmly rooted in a deep understanding of network engineering, Global Wireless Solutions provides best-in-class, turnkey solutions to help customers better understand overall network performance as today’s wireless networks grow and evolve.

Founded in 1996, Global Wireless Solutions is headquartered in Dulles, VA. At last count, Global Wireless Solutions has driven more than 8 million data collection miles for its customers. For more information, visit www.gwsolutions.com and follow us on Twitter at @gwsolutionsinc


Media Contact:

Media Contact Colin Myer / George Chamberlain
Diffusion PR
+44 (0)207 291 0249
gws@diffusionpr.com