Since its release 6 months ago, ChatGPT has garnered immense popularity due to its ability to engage users in meaningful and human-like conversations, revolutionizing the way we interact with AI. The technology behind it, ie. the so-called Large Language Model / Generative AI for languages, has huge potentials in enterprises and governments too, if the concerns of being up-to-date, reliable and controllable can be addressed. In this speech, a solution framework which combines LLM and knowledge graph stored in Neo4j graph database will be presented, together with a quick demo.