Big data, big insight, and potential big trouble

The Australian code outlines a framework of administrative and ethical rules that support the use of responsible data analytics. These rules divide responsibility into three main groups: government agencies, analytics practitioners, decision makers.

For government departments using big data, it is important that big data be collected only as permitted by law. The collection must be fair and necessary in order to enhance a legitimate government purpose, and that there must be sufficient openness and transparency in relation to its collection, storage and use.

For researchers and practitioners of big data, much can be gained by incorporating many of the same types of guidelines now found in most universities. That means adopting their own code of professional practice which will include the importance of keeping accurate records, conducting their research with appropriate scholarly guidelines of honesty and integrity, respecting the rights of participants, ensuring genuine consent of participants and complying with all laws and regulations, including privacy protection.

For business, it is important that data be collected that is relevant and necessary, and that it be done in a way that gives sufficient consideration to privacy and other concerns of consumers. The data needs to be kept secure. Those responsible for legal compliance and risk management should ensure that the design, process, execution and use of big data are compliant with laws protecting privacy, confidentiality, truthfulness, accuracy and reputation.

Whether the information is collected by governments or private entity, where there have been breaches of the law or code, such breaches should be investigated and appropriate corrective action taken.

Given the fact that big data is still a recent and rapidly expanding phenomenon, its use and potential dangers should be the subject of ongoing evaluation and review. In this way, we will be able to maximize the advantages of big data and minimize the disadvantages.

Big data holds great promise of providing insights and enhancing the efficiency of business and government. The use of new technology, however, also brings new risks which must be anticipated with the research, records, processes and outputs managed appropriately and effectively and with due consideration being given to all stakeholders, including consumers and members of the public. The rise of big data also points to the need for society's institutions (business and government) to evolve in ways that ensure that such new technology will be used for the ultimate benefit of society.