A Dataset and a Semantics-Driven Approach to Retrace Attack Campaigns.
Identifying patterns in the modus operandi of attackers is an essential requirement in the study of Advanced Persistent Threats. Previous studies have been hampered by the lack of accurate, relevant, and representative datasets of current threats. System logs and network traffic captured during attacks on real companies’ information systems are the best data sources to build such datasets. Unfortunately, for apparent reasons of companies’ reputation, privacy, and security, such data is seldom available. This article proposes an alternative approach to such issues involved with collecting data. It first presents a formal model of an attacker’s tactical progression during their network propagation phase. Such a progression is expressed according to the attacker’s state, called muSE, which specifies their propagation area, collected secrets, and knowledge of the environment. The new model wields the operational semantics of attack techniques proposed in this article. The semantics formally define a transition relation between attackers’ states. Hence, it can be used to describe an entire attack scenario. This formalization allows the ability to describe the PWNJUTSU experiment unequivocally. In this experiment, 22 Red Teamers attacked the vulnerable infrastructure to compromise machines and steal secret flags. Each Red Teamer operated on a dedicated instance. Sensors captured system logs and network traffic on each of these instances. This article’s second contribution is the public release of the PWNJUTSU dataset.
Published in: IEEE Transactions on Network and Service Management (TNSM), June 2022. HAL archive (open access) 10.1109/TNSM.2022.3183476
online Explore the PWNJUTSU dataset
online Download the PWNJUTSU dataset (direct download)
online Download the PWNJUTSU dataset (IEEE Dataport mirror)
$ tree -h pwnjutsu_dataset
[ 82G] pwnjutsu_dataset
├── [ 81G] network
│ ├── [1.1G] json
│ │ ├── [ 20M] pwnjutsu_dataset-network-json-player_11.tar.bz2
│ │ ├── [4.7M] pwnjutsu_dataset-network-json-player_12.tar.bz2
│ │ ├── [ 24M] pwnjutsu_dataset-network-json-player_13.tar.bz2
│ │ ├── [ 15M] pwnjutsu_dataset-network-json-player_15.tar.bz2
│ │ ├── [7.7M] pwnjutsu_dataset-network-json-player_16.tar.bz2
│ │ ├── [7.4M] pwnjutsu_dataset-network-json-player_18.tar.bz2
│ │ ├── [1.6M] pwnjutsu_dataset-network-json-player_19.tar.bz2
│ │ ├── [ 25M] pwnjutsu_dataset-network-json-player_21.tar.bz2
│ │ ├── [5.5M] pwnjutsu_dataset-network-json-player_22.tar.bz2
│ │ ├── [127M] pwnjutsu_dataset-network-json-player_23.tar.bz2
│ │ ├── [ 81M] pwnjutsu_dataset-network-json-player_24.tar.bz2
│ │ ├── [528M] pwnjutsu_dataset-network-json-player_26.tar.bz2
│ │ ├── [ 17M] pwnjutsu_dataset-network-json-player_27.tar.bz2
│ │ ├── [ 13M] pwnjutsu_dataset-network-json-player_28.tar.bz2
│ │ ├── [ 15M] pwnjutsu_dataset-network-json-player_32.tar.bz2
│ │ ├── [ 47M] pwnjutsu_dataset-network-json-player_33.tar.bz2
│ │ ├── [ 11M] pwnjutsu_dataset-network-json-player_34.tar.bz2
│ │ ├── [ 32M] pwnjutsu_dataset-network-json-player_35.tar.bz2
│ │ ├── [ 17M] pwnjutsu_dataset-network-json-player_36.tar.bz2
│ │ ├── [ 14M] pwnjutsu_dataset-network-json-player_37.tar.bz2
│ │ ├── [ 11M] pwnjutsu_dataset-network-json-player_38.tar.bz2
│ │ └── [ 14M] pwnjutsu_dataset-network-json-player_39.tar.bz2
│ └── [ 80G] pcap
│ ├── [7.5G] pwnjutsu_dataset-network-pcap-player_11.tar.bz2
│ ├── [ 36M] pwnjutsu_dataset-network-pcap-player_12.tar.bz2
│ ├── [163M] pwnjutsu_dataset-network-pcap-player_13.tar.bz2
│ ├── [173M] pwnjutsu_dataset-network-pcap-player_15.tar.bz2
│ ├── [140M] pwnjutsu_dataset-network-pcap-player_16.tar.bz2
│ ├── [464M] pwnjutsu_dataset-network-pcap-player_18.tar.bz2
│ ├── [ 50M] pwnjutsu_dataset-network-pcap-player_19.tar.bz2
│ ├── [7.5G] pwnjutsu_dataset-network-pcap-player_21.tar.bz2
│ ├── [108M] pwnjutsu_dataset-network-pcap-player_22.tar.bz2
│ ├── [577M] pwnjutsu_dataset-network-pcap-player_23.tar.bz2
│ ├── [4.3G] pwnjutsu_dataset-network-pcap-player_24.tar.bz2
│ ├── [1.1G] pwnjutsu_dataset-network-pcap-player_26.tar.bz2
│ ├── [5.3G] pwnjutsu_dataset-network-pcap-player_27.tar.bz2
│ ├── [1.3G] pwnjutsu_dataset-network-pcap-player_28.tar.bz2
│ ├── [414M] pwnjutsu_dataset-network-pcap-player_32.tar.bz2
│ ├── [565M] pwnjutsu_dataset-network-pcap-player_33.tar.bz2
│ ├── [471M] pwnjutsu_dataset-network-pcap-player_34.tar.bz2
│ ├── [514M] pwnjutsu_dataset-network-pcap-player_35.tar.bz2
│ ├── [ 48G] pwnjutsu_dataset-network-pcap-player_36.tar.bz2
│ ├── [176M] pwnjutsu_dataset-network-pcap-player_37.tar.bz2
│ ├── [656M] pwnjutsu_dataset-network-pcap-player_38.tar.bz2
│ └── [222M] pwnjutsu_dataset-network-pcap-player_39.tar.bz2
├── [ 59M] reference
│ ├── [ 57M] pwnjutsu_dataset-reference-network-pcap-n99.tar.bz2
│ └── [1.9M] pwnjutsu_dataset-reference-system-json-n99.json.bz2
└── [125M] system
└── [125M] json
├── [1.2M] pwnjutsu_dataset-system-json-n11.json.bz2
├── [885K] pwnjutsu_dataset-system-json-n12.json.bz2
├── [1.5M] pwnjutsu_dataset-system-json-n13.json.bz2
├── [1.9M] pwnjutsu_dataset-system-json-n15.json.bz2
├── [2.0M] pwnjutsu_dataset-system-json-n16.json.bz2
├── [1.0M] pwnjutsu_dataset-system-json-n18.json.bz2
├── [880K] pwnjutsu_dataset-system-json-n19.json.bz2
├── [3.3M] pwnjutsu_dataset-system-json-n21.json.bz2
├── [3.6M] pwnjutsu_dataset-system-json-n22.json.bz2
├── [6.1M] pwnjutsu_dataset-system-json-n23.json.bz2
├── [ 11M] pwnjutsu_dataset-system-json-n24.json.bz2
├── [ 43M] pwnjutsu_dataset-system-json-n26.json.bz2
├── [2.9M] pwnjutsu_dataset-system-json-n27.json.bz2
├── [996K] pwnjutsu_dataset-system-json-n28.json.bz2
├── [2.3M] pwnjutsu_dataset-system-json-n32.json.bz2
├── [7.1M] pwnjutsu_dataset-system-json-n33.json.bz2
├── [5.3M] pwnjutsu_dataset-system-json-n34.json.bz2
├── [9.1M] pwnjutsu_dataset-system-json-n35.json.bz2
├── [4.2M] pwnjutsu_dataset-system-json-n36.json.bz2
├── [4.0M] pwnjutsu_dataset-system-json-n37.json.bz2
├── [4.5M] pwnjutsu_dataset-system-json-n38.json.bz2
└── [7.7M] pwnjutsu_dataset-system-json-n39.json.bz2
6 directories, 68 files