Detecting shadow lobbying

Slobozhan, Ivan, Ormosi, Peter ORCID: and Sharma, Rajesh (2022) Detecting shadow lobbying. Social Network Analysis and Mining, 12. ISSN 1869-5469

[thumbnail of Lobbying_identification___Paper_4]
PDF (Lobbying_identification___Paper_4) - Accepted Version
Download (420kB) | Preview


Lobbying activity is subject to strict disclosure requirements in the USA. Failure to comply with these requirements can lead to criminal and civil penalties. It is claimed that these tight lobbying disclosure measures resulted in an increase in ‘underground lobbying’. This research proposes a method to discover non-compliance in lobbying disclosure and gauge the magnitude of underground lobbying. We start from the premise that lobbying changes the text of the bills it targets. If these changes happen to some extent systematically, then the texts of lobbied bills should be discernible from non-lobbied bills. We combine the corpus of US legislative bills with a large dataset of lobbying activity to give us a partially labelled dataset, where a positive label indicates a lobbied bill, and the lack of a label indicates either that the bill was lobbied, or was lobbied but not disclosed. To address this partial labelling problem, we first set up a naive classification task, where we assume all unlabelled bills to have a negative label and train a model on a large corpus of US bills. By finding the best performing model, we then design a bagging method and collect out of fold predictions, to predict for each unlabelled bill whether it was lobbied or not. From these predictions, we infer that there are a sizable number of bills that are likely to have been lobbied, but this lobbying activity was not disclosed. We then investigate how the political affiliation of the sponsoring senators and congressmen relates to these probabilities.

Item Type: Article
Additional Information: Funding Information: This work has received funding from the EU H2020 program under the SoBigData++ project (grant agreement No. 871042).
Uncontrolled Keywords: corruption,lobbying,lobbying disclosure,machine learning,information systems,communication,human-computer interaction,media technology,computer science applications,3* ,/dk/atira/pure/subjectarea/asjc/1700/1710
Faculty \ School: Faculty of Social Sciences > Norwich Business School
UEA Research Groups: Faculty of Social Sciences > Research Centres > Centre for Competition Policy
Faculty of Social Sciences > Research Groups > Responsible Business Regulation Group
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 21 Apr 2022 14:30
Last Modified: 21 Apr 2023 01:29
DOI: 10.1007/s13278-022-00875-y

Actions (login required)

View Item View Item