Take the case of great yogis like Swami Vivekananda. They did not work for themselves but the amount of work which that man did until the age of 39 when he passed away, 100 people cannot do in 100 years. How did he do that? His inner energy that takes over; one becomes very resourceful in the selfless action one is doing. So one does not become foolish by doing yoga or meditation.