Reasons to believe there's FIDE rating "inflation"?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Reasons to believe there's FIDE rating "inflation"?

    I regularly hear people say that that FIDE ratings are inflated, but I've never heard a reason to believe it.

    I not only don't believe it, I think it's actually more reasonable to believe that FIDE ratings are deflated. But then I've never heard any reasons to believe that FIDE ratings are inflated, so maybe I'm not fairly considering the whole case.

    My guess is that people say there is rating inflation because they can't believe that the great players they grew up admiring did not play as well as today's highest-rated players. For example, in the early 1980s only Karpov and Kasparov were over 2700, but now there are 50 players over 2700, and some chess fans find it hard to believe that today's 2700s play as well or better than the giants of the past.

    I admit that it seems silly to say that today's Vachier-Lagrave or Mickey Adams plays as well as World Champion Karpov in 1980 -- but I think there are good reasons to believe they both play better. [So as not to skew the discussion, I'll post my reasons for this claim later. The only assumption my argument makes is that FIDE-rating calculations are close to zero-sum, which is not true of CFC ratings.]

    Defining "inflation"?
    At first I thought it might be helpful to have a definition of "rating inflation"; but now I suspect "rating inflation" is a misleading phrase because it prompts people to think about the analogy with economic inflation, and there's no chess equivalent of the economists' basic basket of goods which would allow us to compare prices at different times (e.g. nothing like the Economist magazine's "Big Mac index").

    Whether we use the term "inflation" or not, I think the fundamental issue is that people who claim there is "rating inflation" are trying to explain why they think that 'a 2700 rating isn't what it used to be'. That is, people see that today a 2720 rating gets you a Vachier-Lagrave, but think that's not nearly as good as when it got you the world #1 Karpov, so clearly each rating point is worth less than it used to be because it doesn't move you as high up on the ordinal scale of world ranking. It is true (and obvious) that a 2700+ Elo rating gets you a lower world-ranking than it used to, but it's not clear that it is due to rating inflation or to a widespread increase in the strength of their rated opponents.


    Enough from me for now.

    Here's my request:

    post your best argument for the claim that today's players with FIDE-rating of nnnn (whatever) are not as good as the players with that same FIDE rating from the past.

  • #2
    Re: Reasons to believe there's FIDE rating "inflation"?

    Fide reformed itself around 1950 and started handing out titles. Comparing ratings and titles from then or the late 60's to now is apples and oranges.

    Looks to me like there are a lot of GM titles being handed out and when a real talent makes GM he tends to chew through that field like a hot knife through butter.

    Moving the performance rating for GM to 2650 is the next logical step, not that I expect logical.
    Gary Ruben
    CC - IA and SIM

    Comment


    • #3
      Re: Reasons to believe there's FIDE rating "inflation"?

      I agree pretty much. You won't hear many strong players say their is deflation. Average player now is much stronger than in the past. More well versed in theory, more exposed to tactics (computer generation), and far more outlets to improve are a few large reasons why. We have the benefit of having all our predecessors games to learn from.

      Also, titles are a chess tradition and not a a real measure of strength. The only current objective measure is rating, though definitely not CFC rating :D

      Comment


      • #4
        Re: Reasons to believe there's FIDE rating "inflation"?

        Originally posted by Eric Hansen View Post
        titles are a chess tradition and not a a real measure of strength. The only current objective measure is rating, though definitely not CFC rating :D
        Agreed, which is why I didn't mention titles in the OP.

        Originally posted by Eric Hansen View Post
        Average player now is much stronger than in the past. More well versed in theory, more exposed to tactics (computer generation), and far more outlets to improve are a few large reasons why. We have the benefit of having all our predecessors games to learn from.
        Agreed. These are all common-sense reasons to believe in deflation, so why don't (more?) top players say there is deflation?

        The only top player I know of to discuss this increasing skill level did so near the beginning of the ratings-era:
        "If I were put back in the early 1920s, it would be easy, very easy, to be world champion. There would be many draws, but in enough of the games I would get opponents into positions they didn’t understand. Most people find this arrogant – but now we know so much more. If we take positions they understand, we are not better; but we know more types of position. It is a matter of selecting the right openings."
        - Bent Larsen, 1972
        Last edited by John Upper; Saturday, 2nd February, 2013, 09:19 PM.

        Comment


        • #5
          Re: Reasons to believe there's FIDE rating "inflation"?

          Originally posted by Gary Ruben View Post
          Fide reformed itself around 1950 and started handing out titles. Comparing ratings and titles from then or the late 60's to now is apples and oranges.
          Agree that there are many more opportunities to get a FIDE title, but ratings are earned, not handed out.

          Comment


          • #6
            Re: Reasons to believe there's FIDE rating "inflation"?

            Kenneth Regan analysized the games of the Canadian Open and found that Canadians had deflated FIDE ratings. A US GM noted that we have strong IMs.

            http://www.chesstalk.info/forum/showthread.php?t=7180

            Reportedly, today's 50th player is more knowledgeable than the 50th player of 20 or 40 years ago.

            http://www.cse.buffalo.edu/~regan/Ta...nceCornell.pdf

            Bobby Fischer 2921 in 1971,
            Jose Capablance 2936 in New York 1927,
            Magnus Carlsen 2983 at London 2011.

            Morphy was only 2344.

            Comment


            • #7
              Re: Reasons to believe there's FIDE rating "inflation"?

              Originally posted by Erik Malmsten View Post
              http://www.cse.buffalo.edu/~regan/Ta...nceCornell.pdf

              Bobby Fischer 2921 in 1971,
              Jose Capablance 2936 in New York 1927,
              I read the Regan article in the link [thanks], but I can't follow all the math and stats.

              There's one slide titled "4.Human Skilll Increasing Over Time?" that suggests "mild deflation" since 1971, but it's hard to know what he means when all we have are bullet points.

              OTOH, I need more details about his methodology before I'll believe a study that concludes that Capablanca in 1927 played better than Fischer "over all 3 Candidates's Matches in 1971". Which engines, how many ply, how "difficult" were the decisions in the games?

              FWIW, there was a study done within the last 10 years to calculate IPRs using the engine Crafty. One critic pointed out the serious flaw -- almost a punchline -- with the study: if Crafty was judging games between Houdini and Crafty it would rate Crafty as the better player, because it played the moves that Crafty (the judge) rated as best.

              Comment


              • #8
                Re: Reasons to believe there's FIDE rating "inflation"?

                Originally posted by John Upper View Post

                OTOH, I need more details about his methodology before I'll believe a study that concludes that Capablanca in 1927 played better than Fischer "over all 3 Candidates's Matches in 1971". Which engines, how many ply, how "difficult" were the decisions in the games?

                FWIW, there was a study done within the last 10 years to calculate IPRs using the engine Crafty. One critic pointed out the serious flaw -- almost a punchline -- with the study: if Crafty was judging games between Houdini and Crafty it would rate Crafty as the better player, because it played the moves that Crafty (the judge) rated as best.
                I have no problem rating computers 2900 or 3000 tactically, but positionally (except for the endgame database) they are below 2200 so I agree that they are suspect in assessing the strength of GM games, especially in quiet positions.

                A computer researcher ran a blunder check on all world champion's games and claims Fischer made the least amount of errors, but Capablanca is up there:

                http://www.truechess.com/web/champs.html

                Comment


                • #9
                  Re: Reasons to believe there's FIDE rating "inflation"?

                  I did a little survey last fall. Top 24 on the CFC rating list, also showing USCF and FIDE ratings. Top 3 active Canadians (I'm unsure of Kovalyov's status) according to CFC were Sambuev, Noritsyn, Hansen. According to FIDE they were Sambuev, Hansen, Castellanos

                  September 2012 USCF vs CFC vs FIDE
                  Name USCF CFC FIDE Comments
                  So, Wesley 2692 2724 2667
                  Sambuev, Bator unr 2689 2535
                  Bluvshtein, Mark 2539 2632 2590
                  Kovalyov unr 2644 2598
                  Noritsyn, Nikolay unr 2605 2461
                  Hansen 2479 2579 2502
                  Gerzhoy, Leonid 2539 2571 2461
                  Krnan, Tomas unr 2562 2415
                  Samsonkin, Artiom 2553 2396 1498p USCF from 2001
                  Quan, Zhe 2503 2642 2431 Last CFC game July 2009
                  Castellanos, Renier unr 2501 2491
                  Hambleton, Aman 2488 2293 1990p USCF from 2007
                  Doroshenko unr 2482 2336
                  Porper, Edward unr 2475 2420
                  Hebert, Jean 2466 2399 2452 USCF from 1999
                  Pechenkin, Vladimir 2377 2436 2333
                  Laceste, Loren 2493 2280 2290
                  Calugar, Arthur 2453 2429 2308
                  Panjwani, Raja 2451 2517 2403
                  Hartman, Brian 2443 2438 2374
                  Kaminski, Victor 2418 2315 2247
                  O’Donnell, Tom 2434 2350 2457 USCF from 2000
                  Plotkin, Victor 2411 2354 2208
                  Cheng, Bindi 2402 2480 2415
                  Paul Leblanc
                  Treasurer Chess Foundation of Canada

                  Comment


                  • #10
                    Re: Reasons to believe there's FIDE rating "inflation"?

                    a more readable version: (with averages as well)

                    some of the numbers don't look right (Samsonkin FIDE as 1498?) Maybe the USCF and FIDE columns are mixed up for some people.

                    Code:
                    Name		USCF	CFC	FIDE	Comments				
                    So	Wesley	2692	2724	2667					
                    Sambuev	Bator	unr	2689	2535					
                    Bluvshtein	Mark	2539	2632	2590					
                    Kovalyov	unr	2644	2598						
                    Noritsyn	Nikolay	unr	2605	2461					
                    Hansen		2479	2579	2502					
                    Gerzhoy	Leonid	2539	2571	2461					
                    Krnan	Tomas	unr	2562	2415					
                    Samsonkin	Artiom	2553	2396	1498p	USCF	from	2001		
                    Quan	Zhe	2503	2642	2431	Last	CFC	game	July	2009
                    Castellanos	Renier	unr	2501	2491					
                    Hambleton	Aman	2488	2293	1990p	USCF	from	2007		
                    Doroshenko	unr	2482	2336						
                    Porper	Edward	unr	2475	2420					
                    Hebert	Jean	2466	2399	2452	USCF	from	1999		
                    Pechenkin	Vladimir	2377	2436	2333					
                    Laceste	Loren	2493	2280	2290					
                    Calugar	Arthur	2453	2429	2308					
                    Panjwani	Raja	2451	2517	2403					
                    Hartman	Brian	2443	2438	2374					
                    Kaminski	Victor	2418	2315	2247					
                    O’Donnell	Tom	2434	2350	2457	USCF	from	2000		
                    Plotkin	Victor	2411	2354	2208					
                    Cheng	Bindi	2402	2480	2415					
                    									
                    average		2488	2483	2423
                    Last edited by Roger Patterson; Sunday, 3rd February, 2013, 04:04 PM.

                    Comment


                    • #11
                      Re : Re: Reasons to believe there's FIDE rating "inflation"?

                      Originally posted by Roger Patterson View Post
                      a more readable version: (with averages as well)

                      some of the numbers don't look right (Samsonkin FIDE as 1498?) Maybe the USCF and FIDE columns are mixed up for some people.

                      Code:
                      Name		USCF	CFC	FIDE	Comments				
                      So	Wesley	2692	2724	2667					
                      Sambuev	Bator	unr	2689	2535					
                      Bluvshtein	Mark	2539	2632	2590					
                      Kovalyov	unr	2644	2598						
                      Noritsyn	Nikolay	unr	2605	2461					
                      Hansen		2479	2579	2502					
                      Gerzhoy	Leonid	2539	2571	2461					
                      Krnan	Tomas	unr	2562	2415					
                      Samsonkin	Artiom	2553	2396	1498p	USCF	from	2001		
                      Quan	Zhe	2503	2642	2431	Last	CFC	game	July	2009
                      Castellanos	Renier	unr	2501	2491					
                      Hambleton	Aman	2488	2293	1990p	USCF	from	2007		
                      Doroshenko	unr	2482	2336						
                      Porper	Edward	unr	2475	2420					
                      Hebert	Jean	2466	2399	2452	USCF	from	1999		
                      Pechenkin	Vladimir	2377	2436	2333					
                      Laceste	Loren	2493	2280	2290					
                      Calugar	Arthur	2453	2429	2308					
                      Panjwani	Raja	2451	2517	2403					
                      Hartman	Brian	2443	2438	2374					
                      Kaminski	Victor	2418	2315	2247					
                      O’Donnell	Tom	2434	2350	2457	USCF	from	2000		
                      Plotkin	Victor	2411	2354	2208					
                      Cheng	Bindi	2402	2480	2415					
                      									
                      average		2488	2483	2423
                      I suggest buying a new calculator. With the same numbers (except for IM's O'Donnell and Hebert, for who the ratings were not correct) :

                      Average CFC : 2512
                      Average FIDE : 2413.125

                      And if we remove inactive players or players from provinces were there are no FIDE tournaments, the difference is even higher. With the current CFC rating system, I imagine we could reach a 200 points difference in the next few years.

                      Comment


                      • #12
                        Re: Reasons to believe there's FIDE rating "inflation"?

                        The purpose of chess ratings is not to compare Fischer to Kasparov or Karpov to Carlsen, imo. The purpose of ratings is to provide an easy to understand snapshot of where a player stands with respect to other players in their club/region/province/country/planet.

                        The various categories are supposed to represent the number of players in a given cluster. So, for example, if X% of the world's tournament players are supposed to be Masters then it doesn't matter if they are all a bunch of idiots or a bunch of geniuses at the chessboard.

                        Of course players are getting stronger, especially "average" tournament players who have many more tools to improve. But since the rating system is supposed to be some sort of Bell Curve, if the improvement is say two points per year on average world-wide and you are getting better at one point per year vs your "old self" then your rating should be going down, not up, to reflect your relative standing.
                        "Tom is a well known racist, and like most of them he won't admit it, possibly even to himself." - Ed Seedhouse, October 4, 2020.

                        Comment


                        • #13
                          Re: Reasons to believe there's FIDE rating "inflation"?

                          Originally posted by John Upper View Post
                          I not only don't believe it, I think it's actually more reasonable to believe that FIDE ratings are deflated.
                          The theoretical reason to expect this is mainly that rating-points are zero-sum (unless bonus measures are taken) and people tend to leave with more points than they entered with.

                          post your best argument for the claim that today's players with FIDE-rating of nnnn (whatever) are not as good as the players with that same FIDE rating from the past.
                          One can argue that if the older masters had access to ChessBase and engines and TWIC etc., then they would have been better. I prefer to place the question in terms of, "do today's players deserve their ratings?" This allows a fair reward for the extra industry that goes with the better tools. Otherwise, my system only judges the quality of the moves made on the board.



                          I read the Regan article in the link [thanks], but I can't follow all the math and stats.

                          There's one slide titled "4.Human Skill Increasing Over Time?" that suggests "mild deflation" since 1971, but it's hard to know what he means when all we have are bullet points.
                          The main comparison is with the masters of a hundred years ago, those after Lasker and Capablanca and Alekhine. The bullet about deflation since 1971 is based on the more-detailed slides in this talk, slides 20 and 22 (of 31). There I have plotted the average error per move on a moving average of tournaments of the same FIDE category (grouping 11-12, 13-14, etc.); the second graph starts at move 17 to minimize effects of opening prep. If there were rampant inflation the lines would be sloping up, but if anything the highest-category ones slope down.

                          OTOH, I need more details about his methodology before I'll believe a study that concludes that Capablanca in 1927 played better than Fischer "over all 3 Candidates's Matches in 1971". Which engines, how many ply, how "difficult" were the decisions in the games?
                          It's Rybka 3 to depth 13 (which is "really" 16 or 17, as Rybka condenses the bottom 4 nodes of its search). I am currently migrating to Houdini 3 depth 17 plus Stockfish (version 2.3.1 has been current for awhile) depth 19, which are just a tad stronger in my head-to-head matches than the depth 13 setting of Rybka 3 (and which in turn beats the depth 13 setting of Rybka 4.1). More importantly, I am upgrading the model to include a third skill parameter "d" for depth of calculation, in a way that will also quantify the difficulty and "trappiness" of a move decision. Currently my IPR's are correlating most with accuracy, which is why Capa's steamroller New York 1927 performance rates so highly (and he topped 3000 in a 6-0 whitewash of Bora Kostic in 1919)---both he and Alekhine were no slouches in their QGD-laden match at 2700+ either.

                          FWIW, there was a study done within the last 10 years to calculate IPRs using the engine Crafty. One critic pointed out the serious flaw -- almost a punchline -- with the study: if Crafty was judging games between Houdini and Crafty it would rate Crafty as the better player, because it played the moves that Crafty (the judge) rated as best.
                          I think you mean the study by Matej Guid and Ivan Bratko first presented in 2006 and updated here in 2011. They don't attempt to compute IPR's or any measure of "objective" quality---they can only show relative quality, because they don't fully evaluate all the move choices (just 2), they use much weaker engine settings including Rybka 3 only to depth 10, and they have not observed the log-log scaling law of evaluation differences in proportion to the overall advantage in a position. Your "flaw" does apply in my setup, but apparently only well above 3000 level.


                          Regarding the comments below about CFC vs. FIDE ratings, my tests of last summer's main CFC events mostly corroborate the finding in my 2011 Canadian Open test that the FIDE ratings of Canadian players are deflated. Several things including the Ivanov case and etc. have interrupted my posting the new tests in full, but I can relate that as a sanity-check I analyzed the entire 2012 Aeroflot Open A. Median FIDE rating of the players: 2620. The IPR computed by my model for the entire tournament: 2620. Error bars are +- 25 there, so the exact equality is a coincidence, but the result is good enough to argue that my results for Canada (and for strong players in general) cannot be far off the mark.

                          Thanks for the interest, ---Ken Regan
                          Last edited by Kenneth Regan; Sunday, 3rd February, 2013, 05:29 PM. Reason: minor format improvements

                          Comment


                          • #14
                            Re: Reasons to believe there's FIDE rating "inflation"?

                            The way I see the problem of ever increasing ratings is lost relevance.
                            It is very possible that a 2700 today is playing better than say, Karpov in the '80s - he (not " or she" yet) knows more opening theory, more endgame techniques, etc.

                            But is this relevant from a creativity standpoint and ultimately for the success of chess? How many games of "the new 2700s" does the average player of today know? Karpov's (or Nunn's , Timman's, you name it) games are still relevant and studied today because of their rich content. Does anybody remember anything from the last World Championship match besides Gelfand's blunder?

                            So, in conclusion, better is not necessary relevant.

                            Comment


                            • #15
                              Re: Reasons to believe there's FIDE rating "inflation"?

                              Thanks for your post (and continued IPR analysis).

                              Two quick comments and one nightmare-inducing fact.

                              Originally posted by Kenneth Regan View Post
                              The theoretical reason to expect this is mainly that rating-points are zero-sum (unless bonus measures are taken) and people tend to leave with more points than they entered with.
                              Agreed. That's one deductive argument conclusively proving deflation.

                              I'll post some others later.

                              Originally posted by Kenneth Regan View Post
                              Currently my IPR's are correlating most with accuracy, which is why Capa's steamroller New York 1927 performance rates so highly
                              Good. It would be interesting to compare the complexity of the decisions faced by the avg 2700+ player today vs the past. It's not surprising that Capa scores high in accuracy, since he tended to play simpler positions and repetitive middle-games.

                              Now, to give you nightmares :p

                              Database errors will obviously affect the calcuated IPRs of the players -- garbage in - garbage out.

                              Disturbingly, Chessbase had (has?) errors even in games from World Championship matches: in their 2009 database I found a series of blunders at move 32-36 from the Botvinnik - Smyslov 1957 match game 9 (see below).

                              2010 I sent this and a couple dozen other corrections to Chessbase, and they had them fixed in their next release; but:
                              a) is that the only one?
                              b) do you want to bet that the erroneous game-score was used in the Guid and Bratko study... if not others?

                              pleasant dreams ;)

                              [Event "World Championship 21th"]
                              [Site "Moscow"]
                              [Date "1957.03.26"]
                              [Round "9"]
                              [White "Botvinnik, Mikhail"]
                              [Black "Smyslov, Vassily"]
                              [Result "1/2-1/2"]
                              [ECO "E62"]
                              [Annotator "Upper"]
                              [PlyCount "80"]
                              [EventDate "1957.03.05"]
                              [EventType "match"]
                              [EventRounds "22"]
                              [EventCountry "URS"]
                              [Source "ChessBase"]
                              [SourceDate "1999.07.01"]

                              1. c4 Nf6 2. Nc3 g6 3. g3 Bg7 4. Bg2 O-O 5. d4 d6 6. Nf3 c6 7. O-O Bf5 8. Nh4 Be6 9. d5 cxd5 10. cxd5 Bd7 11. Be3 Na6 12. Bd4 Qa5 13. Re1 Nc5 14. e4 Na4 15. Nxa4 Qxa4 16. b3 Qa3 17. f4 Bb5 18. e5 Nd7 19. e6 Bxd4+ 20.Qxd4 Qc5 21. Nf3 fxe6 22. dxe6 Nf6 23. Rac1 Qh5 24. Ng5 Bc6 25. Bxc6 bxc6 26.Rxc6 Ng4 27. h4 h6 28. Nf7 Kh7 29. b4 Rac8 30. Rxc8 Rxc8 31. Nxd6 exd6 {the book "Botvinnink - Smyslov, 1954, 1957, 1958" (NIC 2009, p.138) gives this as the game continuation:} 32. Qxa7+ ({MEGA2009 continues} 32. Qxd6 Kh8 $4 33. Qd7 $18 Rc3 34. Qd8+ $4 {Did Botvinnik AND Smyslov BOTH miss Qd4+ winning?} Kh7 35.
                              Qd7+ Kh8 $4 36. Qe8+ $4 {and miss it TWICE?} Kh7 37. Qe7+ Kh8 38. Qe8+ Kh7) 32... Kh8 33. Qd7 Rc3 {!} 34. Qd8+ Kh7 35. Qd7+ Kh8 36. Qd8+ Kh7 37. Qe7+ Kh8 38. Qe8+ Kh7 39. Qe7+ Kh8 40. Qe8+ Kh7 {What does it say about Chessbase users that this error in a World Championship game has not been pointed out yet!? 8-(
                              } 1/2-1/2

                              Comment

                              Working...
                              X