Our users are receiving messages that are already not relevant, how can we prevent this?

Always specify the Lifetime parameter if you’re sending the alert without schedule, or the correct End Date if you’re using scheduling pattern.