Physical Education forms an important part of the educational system, even when it never received the importance it deserves. Even though it's included as part of the curriculum from the early stages of education, it has never been taken seriously by the educational system as a whole. Education is the only profession where you talk and perform physically. The concept of Physical Education in the mind of the general public is to enhance activities outside reading textbooks, which includes exercise, sports and so on. The paper here examines physical education under the context of the Indian Education Systems, by critically analysing existing literature and keeping into context the various phases/transitions that have taken place in schools. The reality of the situation, or what takes place on a ground-level shall also be acknowledged.