The agriculture being the major source of revenue for the people in the rural areas in a country like India many measures have been taken to improve the revenue of the farmers. The assessing the ripeness of the fruits is also one of the primary responsibilities of the farmer to fix the proper time to glean the fruits and taking them to the market. Computer vision and the image processing together remains as a key methodology in reducing the human labor and classifying the different stages of maturity is has become very prominent in examining the stages of the fruit growth. As the color seems to be the important feature to be observed in determining the different stages of the fruits maturity and color identification of the tropic fruits is difficult due to the various illuminations and the partial clogging up of the fruits. In order to identify maturity stage of the fruits the paper proposes a RGBD analysis to examine the stages of the fruits and identify the various stages of maturity.