For Surveillance Purpose, Lots Of Method Were Used By The Researchers But Computer Vision Based Human Activity Recognition (HAR) Technologies/systems Received The Most In- Terest Because They Automatically Distinguish Human Behaviour And Movements From Video Data Utilizing Recorded Details From Cameras. But The Extraction Of Accurate And Opportune Infor- Mation From Video Of Human’s Activities And Behaviours Is Most Important And Difficult Task In Pervasive Computing Environment. Due To Lots Of Applications Of HAR Systems Like In Medical Field, Security, Visual Monitoring, Video Recovery, Entertainment And Irregular Behaviour Detection, The Accuracy Of System Is Most Important Factors For Researchers. This Review Article Presents A Brief Survey Of The Existing Video Or Vision-based HAR System To Find Out Their Challenges And Applications In Three Aspects Such As Recognition Of Activities, Activity Analysis, And Decision From Visual Content Representation. In Many Applications, System Recognition Time And Accuracy Is Most Important Factor And It Is Affected Due To An Increase In The Usage Of Simple Or Low Quality Type Cameras For Automated Systems. So, To Obtain A Better Accuracy And Fast Responses, The Usage Of Demanding And Computationally Intelligent Classification Techniques Such As Deep Learning And Machine Learning Is A Better Option For Researchers. In This Survey, We Addressed Numerous Computationally Intelligent Classification Techniques-based Research For HAR From 2010 To 2020 For A Better Analysis Of The Benefits And Drawbacks Of Systems, The Challenges Faced And Applications With Future Directions For HAR. We Also Present Some Accessible Problems And Ideas That Should Be Discussed In Future Research For The HAR System Utilizing Machine Learning And Deep Learning Principles Due To Their Strong Relevance.