Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

We are attempting to dump a block that we produced #2841

Open
JulI0-concerto opened this issue Sep 4, 2024 · 8 comments
Open

We are attempting to dump a block that we produced #2841

JulI0-concerto opened this issue Sep 4, 2024 · 8 comments

Comments

@JulI0-concerto
Copy link

Problem

My validator have panic with the following message:

We are attempting to dump a block that we produced. This indicates that we are producing duplicate blocks, or that there is a bug in our runtime/repla
y code which causes us to compute different bank hashes than the rest of the cluster. We froze slot 287809246 with hash Some(B4CX7tKBdzthkjFPyGS3oThLheoYg
7rm1k7dgk3T5NJu) while the cluster hash is EM9VrzvRmsCZCzFuXetTE899tXFRTsEXBd1HRoK69dq9" location="core/src/replay_stage.rs:1429:25" version="1.18.22 (src
:d47d8c83; feat:4215500110, client:JitoLabs)

I want to clarify that everything was running smoothly before it crashed.

@steviez
Copy link

steviez commented Sep 6, 2024

There should have been a file created in:

YOUR_LEDGER_DIR/bank_hash_details/

It will have the slot and hash in the name, can you please share it ?

@JulI0-concerto
Copy link
Author

JulI0-concerto commented Sep 6, 2024

@JulI0-concerto
Copy link
Author

I am closing this issue. The root cause is primarily related to my build pipeline, which built on the master branch instead of tag 1.18.22.

@steviez
Copy link

steviez commented Sep 9, 2024

The root cause is primarily related to my build pipeline, which built on the master branch instead of tag 1.18.22.

Out of curiosity, how did you determine that building off master was the source of your node diverging ?

@JulI0-concerto
Copy link
Author

JulI0-concerto commented Sep 9, 2024

I’m making this assumption because my node was reporting version 2.0.0. Is version 2.0.0 currently expected to function on the mainnet without the need for feature flag activations?

@steviez
Copy link

steviez commented Sep 10, 2024

Is version 2.0.0 currently expected to function on the mainnet without the need for feature flag activations?

Yes, we (Anza) aim to keep the next version consistent with the previous one. It is not guaranteed (we do make mistakes from time to time) and not recommended (we want to properly test / have chance for audit / etc), but as far as I know, the tip of v2.0 branch is currently compatible with mnb (as is the tip of master branch)

@JulI0-concerto
Copy link
Author

I got this panic error again:
thread 'solReplayStage' panicked at core/src/replay_stage.rs:1429:25:
We are attempting to dump a block that we produced. This indicates that we are producing duplicate blocks, or that there is a bug in our runtime/replay co
de which causes us to compute different bank hashes than the rest of the cluster. We froze slot 290956095 with hash Some(Evmyd4mTSUpzQM1F1w7JWg3h7P7qqun8i
gr8EFP1Cbb7) while the cluster hash is 93J44XcJJtHBHMizgqwCQR2JDfEfP6WCPJonNrBEstk4
stack backtrace:

@JulI0-concerto
Copy link
Author

JulI0-concerto commented Sep 20, 2024

Now I am sure I am with the right version 1.18.22-jito (paladin fork)
I already raised the issue to paladin team.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants