Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrading kestra from 17.5 to 17.8 breaks triggered flows executions #4195

Open
aku opened this issue Jul 1, 2024 · 1 comment
Open

Upgrading kestra from 17.5 to 17.8 breaks triggered flows executions #4195

aku opened this issue Jul 1, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@aku
Copy link

aku commented Jul 1, 2024

Describe the issue

UPD: I've went back to 17.8 and the problem has disappeared.

I guess it would be nice to introduce some sort of compatibility checks between Kestra and plugins versions.
Also, the system should report some compatibility issues during startup when upgrading/downgrading


UPD: the same problem happens after I went back to 17.5 version. this time it is a cron-based trigger

I have a couple of flows with kafka triggers and clickhouse triggers

e.g.:

triggers:
  - id: read_orders_from_kafka
    type: io.kestra.plugin.kafka.Trigger
    keyDeserializer: STRING
    valueDeserializer: JSON
    interval: PT5S
    topic: [TOPIC]
    groupId: [GROUP]
    maxRecords: 7000
    properties:
      bootstrap.servers: [REDACTED]
      sasl.jaas.config: org.apache.kafka.common.security.scram.ScramLoginModule required username="{{ secret('[REDACTED]') }}" password="{{ secret('[REDACTED]' )}}";
      sasl.mechanism: SCRAM-SHA-256
      security.protocol: SASL_PLAINTEXT
      auto.offset.reset: latest
      max.poll.records: 5000

Flows were running smoothly with kestra 17.4 and 17.5
Once I've updated to 17.8 following problem has happened:

A flow creates a new execution that stucks in "CREATED" state.
If I click on the execution id in a global Executions tab or from the flow's Execution tab a message with "execution not found" pops up. However I can delete it by checking a box near to the execution id and clicking on DELETE button.

Also, I've checked that execution's data is available in S3 storage.

image image image

I had to downgrade back to 17.5 to make the flows running again. In 17.8 triggered executions stuck in CREATED state

Environment

  • Kestra Version: 0.17.8
  • Operating System (OS/Docker/Kubernetes): standalone binarie
  • Java Version (if you don't run kestra in Docker):
@aku aku added the bug Something isn't working label Jul 1, 2024
@aku aku changed the title Upgrading kestra from 17.5 to 17.8 breaks flows with triggers Upgrading kestra from 17.5 to 17.8 breaks triggered flows executions Jul 1, 2024
@aku
Copy link
Author

aku commented Jul 5, 2024

I've went back to 17.8 and the problem has disappeared.

I guess it would be nice to introduce some sort of compatibility checks between Kestra and plugins versions.
Also, the system should report some compatibility issues during startup when upgrading/downgrading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Backlog
Development

No branches or pull requests

1 participant
-