Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new idea as multiple times weight updating that update the weight iteratively for same instance. The proposed technique analyzed with popular algorithms from literature and experimented using established tool. The results indicates that mistake rate reduces to zero or close to zero for various datasets and algorithms. The overhead running cost is not too expensive and achieving mistake rate close to zero further strengthen the proposed technique. The proposed technique could be helpful to meet real life challenges.