More than half of train companies have a customer satisfaction score of 50% or lower, according to a survey.
And overall, only 22% of train travellers feel their service is improving despite above-inflation fare rises last month, according to the Which? survey.
Bottom in the 19-company satisfaction table was First Capital Connect, with only 40% of its passengers satisfied with its service.
South-West Trains scored 47%, despite a recent Passenger Focus survey which said 85% of people who used rail services were happy.
The next least-satisfied passengers were those travelling on Greater Anglia trains, with the company scoring only 42%.
The criticism came after it emerged that train company bosses are enjoying six-figure salaries, just as rail passengers are enduring above-inflation fare rises.
The East Coast line, where services are run in the public sector, has as many as eight directors on annual salaries of above £100,000, one earning between £161,000 and £180,000.
The highest paid director at CrossCountry earns £222,000, including pension contributions, as of 2011, while Sir David Higgins, the chief executive of rail infrastructure company Network Rail, was on an annual basic salary of £560,000 as of March 31 2012.
Other companies where satisfaction levels were low included Southeastern (43% satisfied), First Great Western (43%), Northern (44%) and London Midland (45%).
Also below 50% were Southern (48%) and Arriva Trains Wales (48%). The East Midlands Trains' figure was 50%, leaving 10 companies at 50% or worse and nine at better than 50%.
Top of the satisfaction table, compiled from responses from 7,500 regular train users, was West Coast main line operator Virgin Trains with a score of 67%.
London Overground was second with 65%, while the London to Tilbury and Southend company c2c and Merseyrail both scored 64%.
On London Overground, where new trains have been introduced in recent months, 60% of users said they felt the service had improved in the past two years.
The survey also showed that 40% of train travellers are likely to reduce the number of journeys they make as a result of the recent price increases which have season tickets rise by an average of 4.2%.
But a third of commuters said they did not have an alternative way of getting to work and would just have to pay more.
Which? executive director Richard Lloyd said: ''With 1.5 billion train journeys made every year and eight of the 17 UK rail franchises up for grabs in the next two years, customer service should be top of the agenda for every train operating company.
''It is good to see some are performing well on service, but customers clearly feel others need to do better.''
He went on: ''Passengers tell us they are fed up with trains that are delayed, overcrowded and dirty. This is especially disappointing as many commuters can't shop around or change the company they travel with.
''Train companies need to play fair with their customers, especially when they are being asked to pay more for their journeys.''
Responding to the Which? survey, a spokesman for the Association of Train Operating Companies said: ''The independent watchdog Passenger Focus surveys up to eight times as many people a year and last month reported 85% of passengers are satisfied with their service - a record high.''
These were the customer satisfaction scores for each train company, according to the Which? survey:
- Virgin Trains 67%
- c2c 64%
- Merseyrail 64%
- Chiltern Railways 62%
- East Coast 58%
- First Transpennine Express 54%
- ScotRail 53%
- CrossCountry 51%
- East Midlands Trains 50%
- Arriva Trains Wales 48%
- Southern 48%
- South West Trains 47%
- London Midland 45%
- Northern 44%
- First Great Western 43%
- South Eastern 43%
- Greater Anglia 42%
- First Capital Connect 40%