opening book vs experience file

As in chess tournaments and matches...
User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sun Mar 05, 2023 8:37 am

Why did you choose a TC 1m+1s ?

It favors better the engine with the opening book, examples :
- with a TC 1m+1s, if the engine plays 30 book's moves, it increments its clock by 30s => +50% more time.
- with a TC 4m+2s, if the engine plays 30 book's moves, it increments its clock by 60s => +25% more time.

You should know that :
- in chess, the perfect game is a draw so the more time you give the engines the less difference there will be between them.
- even if the engine was trained with a TC 1m+1s on 7 threads, its learned experience data is really very resilient.
Last edited by deeds on Sun Mar 05, 2023 8:44 am, edited 1 time in total.

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sun Mar 05, 2023 8:38 am

How was the experience file trained ?

Initially, i trained Eman on the openings where he had lost during my reference tournament (100 openings from salc_v3_10moves).
Then i trained Eman on the openings where the other engines did better (ex : eman drew when others won, eman lost when others drew, etc).

After each tournament, Eman analyzed its defeats at 10min/move then also the defeats of the other engines.

It's no longer a secret but learned data is better when an engine trains against several opponents because it faces different styles of play.
Since 2 years at 24/7 on few hosts, Eman trains until 4 sparring-partners who also have a learning feature so they don't repeat the same bad lines and try new ones.

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sun Mar 05, 2023 8:39 am

What does reinforced experience data mean ?

reinforced = analyzed with greater depth / more time

When the engines train, they try several moves and depending on their efficiency, they forget them more or less quickly.
It generates some 'secondary' experience data which contains moves with shallow depth => imprecise evaluation.

In addition, depending on the TC and the threads number, the average depth is not very high so the resistance of the experience data is less important.

So it is necessary to reinforce this 'secondary' experience data by analyzing the moves which have a shallow depth.
For example, i analyzed at D40 all the moves of a hundred lines for each trained opening.
It improved the resilience of experience data.

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Tue Jun 20, 2023 8:55 pm

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 hcanfree-upd.bin (Eman 8.40)     :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Sedat Canbaz
Posts: 1295
Joined: Wed Jun 21, 2023 6:29 am

Re: opening book vs experience file

Post by Sedat Canbaz » Wed Jun 21, 2023 6:01 pm

deeds wrote:
Tue Jun 20, 2023 8:55 pm
hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 hcanfree-upd.bin (Eman 8.40)     :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
Sorry to say that,
On what kind of planet do you live ? if not so clear:
You are running via completely unfair conditions!

Private vs Public.. hehe ))

Come on SCCT conditions...and let's see
Under real Arena.. what is going on...!

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Wed Jun 21, 2023 7:22 pm

And it was only a little "warmup" with Eman only set by default (=training mode).
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.

But hey, I'm nice, the games are available...

For engine trainers :
Image
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.

Sedat Canbaz
Posts: 1295
Joined: Wed Jun 21, 2023 6:29 am

Re: opening book vs experience file

Post by Sedat Canbaz » Wed Jun 21, 2023 7:52 pm

deeds wrote:
Wed Jun 21, 2023 7:22 pm
And it was only a little "warmup" with Eman only set by default (=training mode).
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.

But hey, I'm nice, the games are available...

For engine trainers :
Image
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.
Game are available.. hehe...

Please just do not try to FOOLl Me .. OK ?
The way, which I work since many years...
Believe Me...You even did not start!

Games ? you are really very funny...)))
Even if they are available...in PGN, CBH etc.
it does not mean that:
Your current played match conditions are fair....

Why you do not share your exp file ?
Where other chess friends may benefit...

Be generous at least once...

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Thu Jun 22, 2023 7:29 am

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 hcanfree-upd.bin (Eman 8.40)     :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Thu Jun 22, 2023 4:44 pm

Sedat Canbaz wrote:
Wed Jun 21, 2023 7:52 pm
Please just do not try to FOOLl Me .. OK ?
The way, which I work since many years...
Believe Me...You even did not start!
But no one wants to steer results like you ! loool
You don't even know how to measure which book has the best variety, you don't even know how many openings are covered or not by the books, you don't even know which book contains the most moves on a particular opening, etc.
Image

User avatar
deeds
Posts: 652
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Thu Jun 22, 2023 4:44 pm

Sedat Canbaz wrote:
Wed Jun 21, 2023 7:52 pm
Games ? you are really very funny...)))
Even if they are available...in PGN, CBH etc.
it does not mean that:
Your current played match conditions are fair....
People already know what you did several times :

Image

Image

So don't mess with me about fair conditions !

As long as you set learning engines in training mode (default settings) to make your unfair 1vs12 tourneys, you will never have any credibility in learning engines sphere.

Post Reply