Keep it simple. If there's not enough memory we can't validate segments. The LUKS2 specification does not recommend to continue processing LUKS2 metadata if it can not be properly validated.