Big Data Storage Index Mechanism Based on Hierarchical Indexing and Concurrent Updating

In modern war, it is of great practical significance for the military powers to improve the command efficiency of commanders on the battlefield, it is necessary to use real-time, efficient, and reliable big data storage index method. The application of Hibase-based hierarchical index technology and hot data cache replacement technology can effectively improve the query and storage efficiency of big data, and solve the shortcoming of non-primary key data requiring full table scan. ZooKeeper distributed read-write lock can effectively solve the problem of data consistency caused by frequent concurrent updating of big data information. Finally, the experiment proves that Hive’s query efficiency is improved by nearly 12%.