Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[x86_64, dev] topology_custom/test_topology_failure_recovery failed with ConfigurationException #20948

Open
scylladb-promoter opened this issue Oct 3, 2024 · 5 comments
Labels
symptom/ci stability Issues that failed in ScyllaDB CI - tests and framework tests/flaky A problem with a test, having flaky behavior

Comments

@scylladb-promoter
Copy link
Contributor

https://jenkins.scylladb.com/job/scylla-master/job/next/8286/ failed with the following error:


=================================== FAILURES ===================================
_______________ test_tablet_drain_failure_during_decommission.5 ________________

manager = <test.pylib.manager_client.ManagerClient object at 0x7f88be3a2840>

    @pytest.mark.asyncio
    @skip_mode('release', 'error injections are not supported in release mode')
    async def test_tablet_drain_failure_during_decommission(manager: ManagerClient):
        cfg = {'enable_user_defined_functions': False, 'enable_tablets': True}
        servers = [await manager.server_add(config=cfg) for _ in range(3)]
    
        logs = [await manager.server_open_log(srv.server_id) for srv in servers]
        marks = [await log.mark() for log in logs]
    
        cql = manager.get_cql()
        await cql.run_async("CREATE KEYSPACE test WITH replication = {'class': 'NetworkTopologyStrategy', 'replication_factor': 1} AND tablets = {'initial': 32};")
        await cql.run_async("CREATE TABLE test.test (pk int PRIMARY KEY, c int);")
    
        logger.info("Populating table")
    
        keys = range(256)
        await asyncio.gather(*[cql.run_async(f"INSERT INTO test.test (pk, c) VALUES ({k}, {k});") for k in keys])
    
        await inject_error_on(manager, "stream_tablet_fail_on_drain", servers)
    
        await manager.decommission_node(servers[2].server_id, expected_error="Decommission failed. See earlier errors")
    
        matches = [await log.grep("raft_topology - rollback.*after decommissioning failure, moving transition state to rollback to normal",
                   from_mark=mark) for log, mark in zip(logs, marks)]
        assert sum(len(x) for x in matches) == 1
    
>       await cql.run_async("DROP KEYSPACE test;")
E       cassandra.protocol.ConfigurationException: <Error from server: code=2300 [Query invalid because of configuration issue] message="Cannot drop non existing keyspace 'test'.">

test/topology_custom/test_topology_failure_recovery.py:46: ConfigurationException
------------------------------ Captured log setup ------------------------------
@scylladb-promoter scylladb-promoter added symptom/ci stability Issues that failed in ScyllaDB CI - tests and framework tests/flaky A problem with a test, having flaky behavior triage/master Looking for assignee labels Oct 3, 2024
@mykaul
Copy link
Contributor

mykaul commented Oct 6, 2024

Could be dup of #20060 ?

@mykaul mykaul removed the triage/master Looking for assignee label Oct 6, 2024
@scylladb-promoter
Copy link
Contributor Author

@scylladb-promoter
Copy link
Contributor Author

@scylladb-promoter
Copy link
Contributor Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
symptom/ci stability Issues that failed in ScyllaDB CI - tests and framework tests/flaky A problem with a test, having flaky behavior
Projects
None yet
Development

No branches or pull requests

3 participants