Graceful Cancellation

Apps typically process requests until completion. However, users may cancel long-running tasks. Implementing graceful cancellation ensures resources are released immediately and partial results are handled correctly.

The Cancel Hook

Define a cancel method in your App class. This method is called when the supervisor receives a cancellation signal.

1class App(BaseApp):2    async def setup(self, config):3        self.cancel_flag = False45    async def on_cancel(self):6        """Called when user cancels the task"""7        print("Cancellation requested...")8        self.cancel_flag = True9        return True1011    async def run(self, input):12        self.cancel_flag = False13        for i in range(100):14            if self.cancel_flag:15                print("Stopping work...")16                break17            await self.heavy_computation(i)

Node.js apps can also check this.context.cancelRequested, which is set automatically by the kernel.

Best Practices

1. Check Frequently: In loops, check your cancellation flag at the start of every iteration.
2. Clean Up: Close database connections, delete temporary files, or free GPU memory before exiting.
3. Return Quickly: The cancel handler should be fast. Do not block execution there; just set a flag or signal an event.
4. Force Kill: If an app does not respond to the cancel hook within a timeout period (default 30s), it will be forcefully terminated.