Three things to check/do:
Then you can rerun the configuration wizards again, assuring you have enough resources - use the setmemwindow:
setmemwindow -i 20 $ORACLE_HOME/cfgtoollogs/configToolCommands
So not just only when running DBCA, or NETCA, or DBUA; there it was an OID install (the infrastucture).
Edit: maybe check the existance of the files first? Search libnjni10.so; should be in lib as well as lib32, but different sizes.