Couldn't stop Lifecycle Managed Instance

Issue:

We had an issue where the hard disk gets full and since then we can not restart Fusion. It stops always at the ip with the error message "Couldn't stop lifecycle managed instance".

How can we solve this issue?

Environment:

Fusion 4.x and lower

Resolution:

This error could be caused by multiple things and will depend heavily on what environment you are in and why your disk filled up. The key is figuring out why the disk filled up and then addressing that issue. Possible issues could be:

• Log files got too big: if you changed logging levels, the logging/retention policies, or the shipping policies
• Signals got too big: changed raw signal retention policies (say, from 6 months to 90 days), archived signals to some other location, etc.
• Catalog too big: store fewer fields in Solr, get more disk space
• etc

There might not be one answer but research why the disk space ran out and then figure out what to do to resolve it (or get more disk space). 

If you have corruption due to disk space, then that's another set of problems that similarly depends on what got corrupted.  For instance, if you lose a Solr replica to corruption, you can typically just delete that from the file system, and it will get recreated from existing replicas.  But if you lose all replicas for a given shard, you typically will have to reload the data from source.

Cause:

Disk space full