The graph is a natural representation of data in a variety of real-world applications, for example as a knowledge graph, a social network, or a biological network. To better leverage the information behind the data, the method of graph embedding is recently proposed and extensively studied. The traditional graph embedding method, while it provides an effective way to understand what is behind the graph data, is unfortunately sub-optimal in many cases. This is because its learning procedure is disconnected from the target application. In this paper, we propose a novel approach, Customized Graph Embedding (CGE), to tackle this problem. The CGE algorithm learns a customized vector representation of the graph by differentiating the varying importance of distinct graph paths. Experiments are carried out on a diverse set of node classification datasets and strong performance is demonstrated.