Oh my... I just checked the Nexus 5X firmware, and it seems that the ril library is not stored in the system partition, but in a separate vendor partition. I've never seen that before.
Can you please start a logcat (e.g. with CatLog), run the installer app without (!) recovery option and mail me the log? Don't forget to stop the logcat before sending the file.