# Redis is crashlooping and with it all OpenReplay services

**URL:** <https://forum.openreplay.com/t/redis-is-crashlooping-and-with-it-all-openreplay-services/66>\
**Category:** 🛠️ Deployment\
**Tags:** redis\
**Created:** [March 29, 2024, 7:05pm UTC](https://forum.openreplay.com/t/redis-is-crashlooping-and-with-it-all-openreplay-services/66 "2024-03-29T19:05:05Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![dave-the-developer](https://avatars.discourse-cdn.com/v4/letter/d/7ab992/32.png) [@dave-the-developer](https://forum.openreplay.com/u/dave-the-developer)\
**Post date:** [March 29, 2024, 7:05pm UTC](https://forum.openreplay.com/t/redis-is-crashlooping-and-with-it-all-openreplay-services/66/1 "2024-03-29T19:05:05Z")

</div>

Hello,  
My server storage has been full, which I increased then restart the VM. But now it looks like all OpenReplay services are down. Restarting all of the; with `openreplay -r all` doesn’t help as redis is crashlooping therefore preventing other services from starting. It seems its due to a corrupted file(s):

> Bad file format reading the append only file appendonly.aof.57.incr.aof

 ![image](https://europe1.discourse-cdn.com/flex006/uploads/openreplay/original/1X/340a748d9b37890b84ce22ace013f3c011118d26.jpeg)

---

<div class="post-metadata">

**Author:** ![mehdi](https://dub1.discourse-cdn.com/flex006/user_avatar/forum.openreplay.com/mehdi/32/50_2.png) [@mehdi](https://forum.openreplay.com/u/mehdi)\
**Post date:** [March 29, 2024, 7:12pm UTC](https://forum.openreplay.com/t/redis-is-crashlooping-and-with-it-all-openreplay-services/66/2 "2024-03-29T19:12:10Z")

</div>

That’s right, some files are corrupt due to the storage going full and not a proper restart of the services including Redis. Most of OpenReplay services rely on Redis for the data pipeline. If Redis fails to start, all other components would certainly complain and start crashlooping.

Here is how to fix:

1. `cd /var/lib/rancher/k3s/storage/`
2. Under it you should see a directory with `pvc- *****redis-master**** ` in it, then `cd appendonlydir` and finally run `rm -rf *` to delete all files
3. Finally run `kubectl rollout restart sts -n db redis-master` to restart redis