You can force YARN to ignore this by setting up the following properties in yarn-site.xml
<property> <name>yarn.nodemanager.pmem-check-enabled</name> <value>false</value> </property> <property> <name>yarn.nodemanager.vmem-check-enabled</name> <value>false</value> </property>
Hope this helps.
Cool, that works!
So we are just bypassing the physical and virtual memory checks? Does that mean earlier either was hitting some default limit?
Thank you Abhijit.
Yes, you assumptions are correct.