The computer plays poker

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • The computer plays poker

    The computer plays poker

    January 12, 2017

    A while ago we had a discussion on Go, Computers and Chess on this site.

    http://forum.chesstalk.com/showthrea...light=computer

    I vaguely thought that a computer beating a human at poker would be much the same as beating one at checkers, Go or chess. The programs would get stronger and stronger and inevitably win their games.

    Perhaps it is not that easy. This story today from Fortune:

    http://fortune.com/2017/01/12/ai-vs-man-poker-match/

    In Latest Man Vs. Machine Battle, the Machine is Winning

    Barb Darrow

    A very interesting contest is taking place at the Rivers Casino in Pittsburgh where four of the world's best poker players are playing against a machine. And as of now anyway, the machine is winning.

    In this case the machine, named Libratus, is using artificial intelligence (AI) technology developed at nearby Carnegie Mellon University, a hot bed of AI and robotics research.

    The tournament kicked off Wednesday with odds makers favoring the human players 4 or 5 to 1 over Libratus. "But we ended up ahead," Tuomas Sandholm, CMU professor of computer science told Fortune over the phone, sounding delighted. And that was before Thursday afternoon's action, at which time Libratus was extending its lead. There's a live feed if you need play by play.

    But still, Sandholm knows the war has just begun. The "Brains Vs. Artificial Intelligence: Upping the Ante" contest calls for 120,000 hands of Heads-Up No-Limit Texas Hold 'em poker to be played over 20 days. Believe it or not that is possible, Sandholm said, with play starting at 11 a.m. and ending at 7 p.m. each day.

    And, if the human players—Jason Les, Dong Kim, Daniel McAulay, and Jimmy Chou—prevail, they will share $200,000 in prize money.

    This marathon contest is part of the university brain trust's attempt to show that AI, which has already prevailed against humans in tic-tac-toe, checkers, chess, and Go—can do the same in this particular game.

    Here's why this is a tougher challenge: In poker a single player gets an incomplete view of the overall game. For one thing, players have no idea who holds the outstanding cards, and for another, opponents purposely obfuscate their strategy. In short, they bluff.

    "Poker requires intentional deception and withholding of information, and that makes it very hard for computers," Andrew Moore, dean of CMU's School of Computer Science, told Fortune during an interview last week.

    Sandholm agreed. "What's so hard is there is imperfect information unlike in chess, checkers or tic-tac-toe," he noted over the phone on Thursday. "You don't really know the state of the game and you don't really know what's happened in the past since the other players are shielding it from you. You don't know their cards."

    As technical journal IEEE Spectrum put it:

    ...heads-up, no-limit Texas Hold’em represents an especially complex challenge with 10160 possible plays at different stages of the game (possibly more than the number of atoms in the universe). Such complexity exists because this two-player version of poker allows for unrestricted bet sizes.

    Running through all those scenarios requires heavy-duty number crunching. The CMU team used "tens of millions of hours of CPU time" at a large Pittsburgh supercomputer to create the models used in this work, Moore said. A CPU or central processing unit is a common measure of computer power.

  • #2
    Re: The computer plays poker

    The computer plays poker

    January 31, 2017

    From the Pittsburgh Post-Gazette:

    Though it had been a point conceded by the humans for the past week, Carnegie Mellon University’s poker-playing computer, Libratus, on Monday finally, definitely and soundly defeated four of the world’s best Heads-Up, No-Limit, Texas Hold ‘em poker players by a resounding $1,766,250 in theoretical dollars in 120,000 total hands played over 20 days at Rivers Casino.

    “Yeah, this was a beat-down,” said a tired human team member, Jimmy Chou, after finishing his 30,000th hand late Monday afternoon.

    Tuomas Sandholm, the CMU computer science professor who created Libratus with his Ph.D. student, Noam Brown, said the win was “awesome” for artificial intelligence research.

    “This is a landmark in AI,” he said.

    His colleagues around the country seemed to agree.

    “This is exciting news out of Pittsburgh,” said Oren Etzioni, chief executive officer for the Allen Institute for Artificial Intelligence in Seattle. “It is significant because [poker] is an imperfect information game.”

    Eric Jackson, a private entrepreneur who designed another poker-player bot named Slumbot that finished second to Mr. Sandholm’s computer in a bot-versus-bot poker tournament last year, agreed with Mr. Etzioni.

    “It is a surprisingly large jump in improvement after being pretty significantly beaten the last time,” Mr. Jackson said. “This is the first time anybody has beat the top pros in a No Limit game.”

    This was the second match between a CMU poker-playing computer and four of the world’s best poker players. The last time — in May 2015 — the humans won by $732,713 over 80,000 hands, won almost every day, and had three of the four team members beat that computer, nicknamed Claudico, in total winnings.

    This time, not one of the four players individually beat Libratus. The best showing came from returning player Dong Kim, who lost by $85,649 over the 20 days. The human team this time only won five of the 20 days.

    See:

    http://www.post-gazette.com/local/ci...s/201701310147

    and

    https://www.theguardian.com/technolo...rs-competition

    Comment


    • #3
      Re: The computer plays poker

      I'm wondering how many online poker sites will still exist in the following months or years. In the online chess you can have some "cheating algorithms" in place but I don't see how it can be done in poker.

      Comment


      • #4
        Re: The computer plays poker

        Originally posted by Rene Preotu View Post
        I'm wondering how many online poker sites will still exist in the following months or years. In the online chess you can have some "cheating algorithms" in place but I don't see how it can be done in poker.
        Full Tilt/Poker stars has software that searches for other programs running at the same time on a single computer when the initial download/install is done the detector software comes along with it. That being said a sophisticated programmer could run another computer in parallel that could monitor and send decisions to the computer where the software resides.

        Comment

        Working...
        X