Smart grid has complex dependencies between physical and cyber realms mqtt ; theft15 ; theft18 ; theft16 . This has been demonstrated by recent attacks on smart grid (Table 3) dagle ; corsi ; larsson ; berizzi ; gomes ; imai . These attacks exploited a limited visibility of the system and inadequate support from reliability coordinators theft17 ; theft22 ; bhatt ; nerc1 ; zima ; theft12 ; ashton ; naspi1 ; gomes2 ; theft19 ; theft20 ; theft21 . Wide-area measurement systems (WAMS) increase the situation awareness (SA) for operators sutar ; narendra ; novosel . WAMS devices that are part of the wide area monitoring, protection, automation and control include phasor measurement units (PMUs) at transmission, frequency disturbance recorders (FDRs) at low-voltage distribution and micro-PMUs (PMUs) for distributed renewables, called synchrophasors gentz ; reddy ; amare ; theft13 ; theft14 ; negash ; rahman ; nazari ; chouhan ; micropmu .
Significant challenges to the implementation of synchrophasors have emerged in communication, data quality and cybersecurity. The existing communication infrastructure is slow, expensive and inflexible. To leverage SA and support timeliness, adequate quality checking methods must be in-place at the phasor data concentrators (PDCs) which aggregate and process raw data and flag corrupt data. Due to their ubiquity, synchrophasors have an increased attack surface. The applications and challenges of synchrophasors are well-researched sexauer ; singh ; sanchez ; tushar ; lauby ; mohanta . However, the challenges of data quality and cybersecurity are considered one independent of the other, when in reality, they are interdependent pmudqnaspi ; christo ; zhu ; yangbo ; nadia ; veda ; sabha ; danielson2013analysis ; huyi ; kdjones ; huang ; huang1 ; gpsspoof ; morris ; cyberlikeli ; cyberthreats ; hlin ; beasley ; tiago ; energies ; auth01 ; auth02 ; auth03 ; attack01 ; attack02 ; doesecchal ; pmuchal ; re10
. Further, the literature does not leverage the knowledge of one challenge to address the other. For example, studying the changes to data quality can be key to potentially identify an underlying attack vector or an unexploited vulnerability.
The main contributions of this paper are: (1) maps the dependencies between data quality and cybersecurity challenges of synchrophasors; (2) reviews the methods to evaluate the challenges; and (3) surveys how data quality checking methods can leverage their observations to detect issues related to security. The paper also provides a high-level overview of synchrophasors, their standards, key applications, and challenges johnson ; martin ; ali ; retty . It is key to know that poor quality can be due to device errors or communication challenges like congestion and packet collision. Similarly, all cyber-attacks do not impact the data, although reduction in quality is one of the biggest observable consequences of a successful attack. A layout of WAMS comprising synchrophasors is shown in Fig. 1. This paper explores the challenges for PMUs at transmission and FDRs at distribution level.
This survey paper considers data quality and cybersecurity as challenges, where each has different issues. Issues are the ways in which the particular challenge manifests when observed. Figure 2
maps the challenges to their corresponding issues. The challenge of quality manifests in three ways: noise, outliers and missingness. Noise can be due to logical inconsistencies in data values or attributes while outliers result from poor integrity and origination. Missing data is a direct consequence of poor completeness and availability. Accuracy is impacted by noise, outliers as well as missingness while plausibility is a characteristic impacted by noise and outliers. These characteristics are discussed in Section3.1. Cybersecurity manifests as delay/loss, manipulation or theft. While a delay/loss corresponds to a packet delay or drop due to congestion, timeout, buffer fullness or an intentional attack that affects availability, manipulation deals with attacks that alter the information, thereby impacting integrity. Theft captures attacks which compromise the confidentiality of data such as snooping, spoofing or espionage. These attacks occur at different levels of the synchrophasor hierarchy: device corresponds to the edge devices like PMUs, FDRs, or PMUs, while aggregator implies Local PDCs or SuperPDCs. Communication refers to the synchrophasor network while Application contains the different power system applications that use synchrophasor data.
The rest of the paper is organized as follows. Section 2 summarizes the architecture, major applications and key challenges of synchrophasors. The characteristics are described in Section 3, and their interdependencies mapped in Section 4. While evaluation methods for data quality and cybersecurity are discussed in Section 4.1, Section 4.2 surveys methods which use data quality characteristics to detect potential cyber-attacks. Section 5 highlights future directions of research in synchrophasor data analytics and cybersecurity.
2 Architecture, Applications, Challenges
Synchrophasors can be standalone devices with dedicated purposes, or be a part of a larger system like the substations, depending on various functional and operational requirements. With increased penetration of renewables and smart loads, synchrophasors are used at distribution transformers and points of common coupling to study frequency disturbances and harmonics. The architecture of synchrophasor devices are summarized at the device and network levels below.
PMU device: It comprises Current Transformers (CTs) and Potential Transformers (PTs) that measure current and voltage magnitudes which are then converted to digital data, a microprocessor module that compiles these values, computes phasors, and synchronizes them with the Coordinated Universal Time (UTC) standard reference used by global positioning system (GPS) receivers that acquire a time-lag based on the atomic clock of GPS satellites premerlani ; ieee2 ; sutar ; phadke ; rihan . They measure local frequency and its rate of change, and can record individual phase voltage and current along with harmonics, negative and zero sequence values eval4 . The information paints a dynamic picture of the grid at a given time. PMUs and PDCs transmit measured data as frames ieee3 . A -bit cyclic redundancy check ensures data integrity. PDCs equipped with logging functionality use comma separated values or transient data exchange for data logs, and Common Format for Event Data Exchange for event logs kezunovic ; ieee4 . The data transfer rate of PMUs, which determine the message processing delays and network latencies, depend greatly on the timing requirements of applications.
PMU network: If there are multiple PMUs in a substation, Local PDCs aggregate site-level data and then transmit to a SuperPDC. PDCs conduct various data quality checks and set flags according to the issues encountered, log performance, validate, transform, scale and normalize data, and convert between protocols ieee1 . There is typically a direct interface between PDC and the utility’s SCADA or energy management system. PDCs can be deployed as standalone devices or integrated with other systems in the grid.
FDR device: The Oak Ridge National Laboratory and the University of Tennessee Knoxville have been leading the FNET/GridEye project since 2004. FDRs have been installed and managed to capture dynamic behaviors of the grid. Although FDRs are essentially PMUs, they are connected at , and hence incur lower installation costs than traditional PMUs do chai . FDRs are largely deployed at renewable integration zones of the grid, and measure nearly samples per second with a hardware accuracy of while PMUs measure between and samples per second and use GPS receivers that have s accuracy for synchronization egypt ; liu ; stenbakken ; wang . Given the availability of an extensive discussion of the architecture by the author of fdrdev ; fdr3rd , it is beyond the scope of this paper.
FDR network: FDRs use the internet to send data directly to the central servers for analytics and can provide information on transients, load shedding, breaker reclosing and the switching operations of capacitor banks and load tap changers wang . Unlike PMUs, FDRs can be installed at buildings and offices.
Synchrophasor standards: Multiple standards exist for PMU data measurement, transfer and communication, proposed by IEEE, the National Institute of Standards & Technology (NIST), the North American Electric Reliability Commission (NERC) and the International Electrotechnical Commission (IEC) ieee5 ; ieee6 ; ieee7 ; firouzi ; mackiewicz ; iec1 ; nistir ; cip . Due to multiple specifications and guidelines, there are possible contradictions in recommendations mehta ; johnson ; martin ; ali ; retty . A North American SynchroPhasor Initiative (NASPI) report in early 2016 identified the need for standardizing definitions related to synchrophasor data quality and availability by establishing the PMU applications requirements task force (PARTF) naspi16 . IEEE standard C37.X deals with WAMS, specifically PMUs ieee1 ; ieee8 ; ieee9 . These standards are summarized in Table 1 with their core contributions highlighted. A more comprehensive review of the synchrophasor standards is documented in synchstd .
|IEEE||1344-1995||Original parameter definitions for synchrophasors|
|C37.118-2005||Improved message formats, inclusion of time quality, Total Vector Error (TVE)|
|C37.239-2010||PMU/PDC event logging|
|1711-2010||Serial SCADA Protection Protocol for substation serial link cybersecurity|
|C37.118.1-2011||PMU measurement provisions, performance requirements|
|C37.118.2-2011||Synchrophasor data transfer requirements|
|C37.238-2011||Common profile for applying Precision Time Protocol (PTP) using Ethernet|
|C37.242-2013||Synchronization, calibration, testing and installation of PMUs for PC|
|C37.244-2013||PDC functions and requirements for PC and monitoring|
|C37.111-2013||PMU/PDC data logging using COMFEDE|
|1686-2013||Procuring, installing and commissioning IED cybersecurity|
|C37.240-2014||Sound engineering practices for high cybersecurity of substation APC|
|IEC||61850||Interoperable and adaptable architectures to substation automation|
|61850-90-5||Requirements for data exchange between PMUs, PDCs, PCs and control center|
|62351-1,2||Security threats and vulnerabilities in smart grid devices|
|62351-6||Prescribes digital signature using asymmetric cryptography for sending PMU data|
|NERC||CIP 002-009||Series of standards to ensure enterprise, field and personnel security|
|NIST||NISTIR 7628||Provides guidelines for smart grid cybersecurity (including WAMS)|
Applications: Synchrophasors streamline security, reliability and stability of power systems. They have online and offline applications smartcity
. Online applications of PMUs include enhancing real-time SA, analyzing faults and disturbances, detecting and appraising oscillations and harmonics that impact power quality, and improving accuracy and reducing computational time of state estimation. Offline applications include congestion management, providing effective protection schemes, benchmarking, system restoration, overload monitoring and dynamic rating, validating the network model of SCADA, and improving overall power qualitynovosel ; iotsg ; appmag . Real-time (online) applications of FDRs include frequency monitoring interface integrated with command and control centers in the future for power system health diagnosis to prevent cascading failures, and event trigger module that detects and notifies the mismatch between generation and load caused by frequency variations. Offline applications include event visualization that renders the data read from the even data files zhangfnet .
Challenges: One of the major drawbacks of synchrophasors is the lack of transmission protocol, which makes them vulnerable to spoofing attacks gentz . The existing architecture is not scalable since it entails an initially high investment. NASPI’s research initiative task force (RITT) emphasizes optimal placement as a significant challenge but also one dependent on the nature of applications the utility intends to use them for naspi1
. The literature has multiple models including but not limited to genetic algorithm, simulated annealing, Tabu search, Madtharad’s method, particle swarm optimization, artificial neural networks, binary search and binary integer programming to address this challengereddy ; amare ; negash ; rahman ; nazari ; chouhan ; yuill ; manousakis . More recently, managing and analyzing large volumes of synchrophasor data has become increasingly challenging. Lack of standardized data management solutions for smart grid has only made this problem more challenging. The ubiquitous presence of these devices has expanded their attack surface, making them vulnerable to different types of attacks. These two challenges are elaborated in the following section since they percolate to applications that directly operate upon the streaming data subject to minimal processing owing to timeliness requirements.
3 Data Quality and Cybersecurity Challenges in Synchrophasors
Due to their wide-ranging communication and automation capabilities, the challenges of synchrophasor data quality and cybersecurity have gained prominence.
|Completeness (Device, aggregator) huyi ; pmudqnaspi ; wuh||
|Measurement Accuracy (Device) pmudqnaspi ; christo ; terzija ; wuh ; cokkinides ; stenbakken1||
|Attribute Accuracy (Device, aggregator, communication) pmudqnaspi ; zhu||
|Plausibility and Availability (Communication, application) veda ; sabha ; kdjones ; heiko ; maab ; danielson2013analysis||
|Origination (Device, aggregator, communication, application) pmudqnaspi ; castello ; dua ; huang1||
|Logical Consistency (Aggregator, communication) pmudqnaspi||
3.1 Data Quality Challenges
NERC’s real-time tools best practices task force (RTBPTF) and NASPI’s PARTF impose requirements to ensure synchrophasor data quality pmudqnaspi ; pmudqnerc . Data quality can be contextualized in different ways, depending on the needs of the concerned domain. For instance, data quality requirements of a smart meter recording energy consumption might differ from those of a net meter at a solar photovoltaic (PV) power plant. NASPI contextualizes synchrophasor data quality to determine “fitness of use” in terms of accuracy and lineage for static data points; lineage, completeness and logical consistency for static datasets; and availability, timeliness and origination for streams of data points pmudqnaspi .
There could be different causes for poor data quality: a) Device: poor calibration of device, biases due to CT, PT; erroneous filter design, poor synchronization of timing measurements, and issues due to measurement channel; b) Communication: latency exceeding stipulated limits, network congestion, signal interferences and failure of communication nodes; c) Aggregator: Data transformation resulting in errors, delayed arrival of packets dropped due to time-limit exceeding, and unwanted duplication or corruption of data during computations; and d) Application: storage and maintenance issues, insufficient training size, erroneous manipulations to the data and poor association of context. Although data quality requirements vary with applications, they have been extensively documented synchstd ; huang ; pmudqnaspi ; pmudqnerc . The existing literature on synchrophasor data quality is summarized in Table 2.
Completeness: focuses on the gaps between different values, accounts for missing values pmudqnaspi . The attributes of completeness defined at device and aggregator-levels are:
gap rate- number of gaps in data per unit time; mean gap size- mean of the length of known gaps; and largest known gap- length of the largest known gap among the different gaps. While completeness is impacted by device malfunction, packet drops and communication link failure, the literature does not recognize the possibility of an attack behind such causes.
Accuracy: can be of the value or attribute, primarily measured in Total Vector Error (TVE), which according to IEEE standard C37.118, is the vector difference between the measured and expected phasor value (magnitude, angle and frequency). Accuracy is categorized into that of: data values- impacted by factors like the difference between expected and observed signals or the introduction of noise to the data within the synchrophasor; and data attributes- affected by factors like accuracy of the measured timestamp, agreement between encoded and actual location coordinates of the device, and alignment of the location recorded in the power system topology with its actual location nadia .
Plausibility and Availability:
Measurement specifiers are the attributes of data which describe whether the process of measuring some phenomenon of the power system (observed value) and calculating its value (expected value) are documented effectively in terms of standard units to a given precision and are within a stated confidence intervalnadia ; sabha . These specifiers have decisive sub-attributes influencing the qualitative value of data: data representing the measurement of quality or condition of the grid, and data represented in the form of SI units up to 3 decimal places with a confidence interval included.
Network availability plays an important role in streaming data danielson2013analysis , and in-turn affects data availability. In case of high network latency, the incoming data streams from different synchrophasors get delayed or lost, causing applications to perceive them as missing or incomplete. Hence, network availability can be considered an indirect attribute affecting quality. This can be mitigated if the overlying applications are programmed to account for the delays, or if a more lenient waiting time limit is set. However, the second solution is dependent on the kind of applications the synchrophasors cater to. The latency requirements for synchrophasors recommended by the standards are very stringent.
Origination: is the source from which the data is measured. Its trustworthiness is associated with the background and source. Its attributes are: point of origin: the class of device from where the data originated (Measurement (M) or Performance (P) for PMUs), the standard followed by the device, and any data manipulation or standardization techniques through which the data passes eval5 ; pmudqnaspi ; coverage: physical location of the device based on its geospatial or electrical topology location zhu ; yangbo ; and transformation applied to the data at the device, aggregator or application level.
|Source of Attack (Year)||Target of Attack||Data Quality Characteristic Impacted||Cybersecurity Characteristic Impacted||Attack Specifics|
|Vulnerability in network firewall (2001)||California ISO (CAISO) web servers||Consistency, accuracy||Integrity||Poor security configuration during planned maintenance|
|Stuxnet worm (2010)||Programmable Logic Controllers (PLCs) at SCADA||Accuracy, consistency, plausibility||Integrity, Availability||Exploits zero-day vulnerabilities of PLCs|
|BlackEnergy (2011)||Human-Machine Interface of utility grid control systems||Plausibility, origin, accuracy, consistency||Confidentiality, Integrity, Availability||General Electric’s HMI targeted|
|Remote Access Trojan; watering-hole attack (2014)||ICS/SCADA||Plausibility, origin, accuracy, consistency||Confidentiality, Integrity, Availability||Conducted by Dragonfly, Energetic Bear|
|Trojan.Laziok reconnaissance malware (2015)||Energy companies||Origin, plausibility||Confidentiality||Gathered information from compromised devices|
|BlackEnergy3 (2015)||Ukrainian grid control center||Plausibility, origin, accuracy, consistency||Confidentiality, Integrity, Availability||Lack of SA left 220,000+ customers without power|
|WannaCry ransomware cryptoworm (2017)||Computers running MS Windows Operating System||Availability, origin||Availability||Used EternalBlue, a vulnerability in older Windows systems|
Consistency: determines how agreeable the data is with the overall structure of its type. Incompatibility of attributes in terms of measurement rates or header labeling between datasets results in outliers, leading to an inconsistent result from an application. The attributes of consistency are: Header frame consistency: consistency of the Header frame of the device. This could be categorized into: persistence of PMU Header that states whether the PMU header structure is consistent over time, and persistence of PDC Header that states whether the PDC header structure is consistent over time; Data frame consistency: consistency of Data frames of the device. This could be categorized into: persistence of PMU Data frame that states whether the PMU data frame structure is consistent over time, and persistence of the PDC Data frame that states whether the PDC data frame structure is consistent over time; order consistency of Data frames: whether the order in which the Data frames are recorded is consistent in the device; consistency in compliance to standards recommended for PMU and all the devices associated with it; and consistency of reporting rate: whether data reporting rate is consistent across all devices.
Emerging research in this area has lately focused on determining solutions for ensuring data quality. These solutions include using omnidirectional antennas to improve GPS availability, context-aware determination of missing data streams using accurate timing information, Network Time Protocol (NTP) and associated chip scale atomic clocks (CSACs) as backups for synchronization when GPS fails, imputation, interpolation and extrapolation, stochastic forecasting with prediction error minimization (PEM) and data substitution huang .
Evaluation of Quality: Methods to evaluate quality is discussed in Section 4.1. The approach for performance evaluation is to first study the impacts of device calibration and network conditions on quality, then examine how poor quality reduces the application performance pmudqnaspi . Two effective methods are proposed to evaluate the impact of quality on performance: benchmarking that tests an application multiple times with numerous erroneous datasets in contrast to those with no known errors, and standardization that documents, for each application, the level of tolerable errors.
3.2 Cybersecurity Challenges
|Device, Aggregator synchstd ; flexpdc ; wuh ; cip ; gpsspoof ; morris||
|Communication cokkinides ; stenbakken1 ; zhushi ; heiko ; maab ; cyberthreats ; energies ; auth01 ; attack02||
|Application castello ; dua ; auth02 ; auth03 ; attack01||
Synchrophasors cater to applications like state estimation, contingency analysis and optimal power flow that need real-time high-resolution data measurement, communication and analytics inlsec . Therefore, a successful attack on these devices might cause erroneous SA or cascading failures synchrodqup ; cyberlikeli . Yet, many industrial organizations do not consider synchrophasors as critical cyber assets. Recent cyberattacks on the smart grid (Table 3) mostly used powerful malware like worms, viruses or Trojan horse, but a few attacks like the one on the Pacific Gas & Electric transmission substation relied on physical means. These attacks jeopardized not just the availability of power but also that of control data (information). Cybersecurity of synchrophasors are categorized into: 1) Device, Aggregator, 2) Communication, and 3) Control center application.
Device, Aggregator: NASPI Network (NASPInet) is logically capable of integrating WAMS across multiple geographically distant organizations using phasor gateways (PGWs). The attacks at this level compromise data integrity, targeting devices from individual PMUs to PDCs, SuperPDCs or even PGWs. Some attacks include: 1) tampering the signal measurement units of devices through interference, 2) illicitly changing the calibration of devices to report erroneous readings, 3) forging data to reflect wrong measurements, and 4) GPS spoofing by broadcasting fabricated signals to the receiver to yield erroneous synchronization of phasors computed, modifying satellite position, or replaying legitimate GPS signals at later timestamps gpsspoof .
GPS spoofing can be mitigated by enabling the receiver to predict visible GPS satellites at a given position and time instant and use the Coarse/Acquisition (C/A) code from those satellites. Another strategy compares the measured GPS signal to the estimated signal and computes the anomaly error which must have an accuracy of for nearly of the values according to IEEE C37.118 zhu . Synchrophasors must be subject to rigorous testing before installation. Some methods include port scans, device security feature robustness, network congestion testing, denial of service testing, network traffic sniffing and disclosure testing morris . These tests should be periodically conducted by certified white hat penetration testers after installation. Regular patches and configuration updates must be made down to the end-device level.
|Level||Quality Attribute||Quality Issue||Cyber-Attack Observed||Security Attribute Impacted|
|Device||Completeness, accuracy, plausibility||Synchronization signal loss, measurement signal loss, missing data||GPS spoofing, replay, device tamper, changing device calibration, FDI||Integrity|
|Aggregator||Origin, consistency, plausibility||Corrupted data, anomalies, outliers||FDI, Tampering, Buffer overflow, MITM||Confidentiality, Integrity|
|Communication||Availability, origin, consistency||Anomalies, outliers, inconsistent, out-of-order data||DoS, MITM, FDI, snooping, replay, delay||Confidentiality, Integrity, availability|
|Application||Origin, availability, consistency, completeness, accuracy||DoS, delay, APT, FDI, theft/fraud, insider attack||corrupted data, missingness, anomalies, outliers||Confidentiality, Integrity, Availability|
Communication: Synchrophasors support bidirectional communication channels, where data measurements flow from devices to the control center while control signals flow the other way. The vulnerabilities of the protocols used by the devices also contribute to the overall security. Attacks on communication channels compromise integrity, availability and confidentiality. Some attacks include: 1) Denial of Service (DoS) by overwhelming PMUs, PDCs or other aggregation devices higher in the hierarchy with bogus frames so that legitimate frames are lost, delayed, denied or dropped, 2) Man-in-the-Middle (MITM) attacks by a malicious entity posing itself as PDC (to PMU) or PGW (to PDC) and sending malicious commands that causes PMUs/PDCs to behave in an abnormal manner that triggers failures, 3) False Data Injection (FDI) by intercepting frames over the channel, altering or replacing them with malicious information that then gets propagated to higher levels of the WAMS, 4) Snooping by the attacker eavesdropping on the channel for incoming or outgoing frames, typically not modifying or stealing but just capturing a copy of that information for packet replay or espionage, and 5) Delay caused by compromising communication routers that deliberately induce latencies in propagation to critically affect the grid’s SA.
Many authentication and authorization algorithms are proposed to secure synchrophasor data over communication channels cyberthreats . These methods range from conventional encryption methods to cyber trust. Due to the ubiquity and widespread range of these devices, key distribution and management becomes a problem. Mutual authentication is also proposed to account for trust energies . Decentralized, blockchain-based trust acquisition is being considered too. The publish-subscribe hub-spoke architecture proposed by NASPInet supports dynamic sharing of device data to alleviate shortcomings of the communication medium like delays and latencies. Standards like IEC 61850-90-5 recommend trusted key distribution center to generate and distribute keys that meet system requirements auth02 ; auth03 ; attack01 ; attack02 .
Application: Despite being protected by enterprise security tools for intrusion detection and prevention, virtualization, segmentation, authentication, authorization and access control, cyberattacks still proliferate doesecchal ; pmuchal
. It is understood that any successful attack at the other two levels perpetrated in a manner undetectable by the enterprise security systems can pose a significant threat. The attacks at this level are the most dangerous, since crucial power system applications use data from WAMS to conduct analysis to address reliability, power quality, network topology, and faults. An adverse impact on these calculations could compromise the “self-healing” nature of the grid. More recent solutions include game theory, machine learning, proactive data visualization, and Defense-in-depththeft22 ; human .
3.2.1 Evaluation of Security
Works have tested the resilience of PMUs and PDCs against different attacks. The authors in cybersec1 conducted penetration testing of a synchrophasor network in IEEE 68-bus system to map vulnerabilities against the Common Vulnerabilities Exposure (CVE) database. Potential corrective measures to ensure the security of PMUs and PDCs is proposed cybersec2 . Considering the security at substation and information levels, the authors provide a wide range of tools to mitigate breaches at both fronts. A multilayered architecture at the substation is proposed where different levels of data abstraction is provided between PMUs and external environment, supplemented by firewalls, User Datagram Protocol (UDP) Secure for communication over untrusted networks, and remote access using Secure Shell (SSH).
4 The Data Quality-Cybersecurity Dependency
The severity of an attack can be understood from the extent of its impacts on the targeted system. With the smart grid encouraging interoperability between devices, information, applications, and protocols, a transparent and direct information exchange is now feasible. This also means that if information in one of the interconnected systems is infected, it is bound to propagate to other systems upon exchange, affecting the whole network. Synchrophasor devices harbor such vulnerabilities, as summarized in Section 3.2. However, to mitigate cyberattacks on interconnected systems, the relationship between devices and data must be known.
|Noise (DQ)||Consistency, accuracy||
|Outlier (DQ)||Consistency, origin, accuracy||
|Missingness (DQ)||Completeness, availability, accuracy||
|Delay/loss (CS)||All levels||
|Manipulation (CS)||Device, Aggregator, Communication||
|Theft (CS)||Device, Aggregator, Communication||
Table 5 summarizes key interdependencies between the two challenges. There is a tight coupling between data quality and cyber-attacks, implying it is wise to study synchrophasor cybersecurity by accounting for the impacts on quality. In most attacks, plausibility, completeness, accuracy and consistency are primarily impacted anurag ; kzhu . In Section 4.1, specific evaluation methods for quantifying this relationship are reviewed. Section 4.2 looks at how data quality characteristics can be used as markers to detect potential cyber-attacks within the context of synchrophasors. Results from these subsections are summarized in Tables 6 and 7, respectively.
4.1 Interdependency Evaluation Methods
Next to communications, cybersecurity was found to impact the design and installation costs for synchrophasors eval2 . This is because they are critical to the mission-support systems of the grid. Different practical ways for utilities to mitigate quality issues like accuracy, timeliness and consistency are also identified. Some methods include employing dedicated communication channels between PMUs and PDCs, encrypting PMU data before communication, and enhancing communication endpoints using firewalls and routers. The report, however, does not delve into the details of how such methods could impact latency (and hence, timeliness) and availability of the data.
Given different manufacturers of devices, there will be differences in measurement and calibration quality despite adhering to the standards. The varying application requirements cause differences in application-level PMU performance, of which data quality is a major one. The static and dynamic PMU testing efforts of the Performance and Standards Task Team (PSTT) of NASPI and the PMU performance characterization are briefly summarized in eval6 . In it, the different steady-state tests performed on magnitude, phase and frequency evaluate their conformance to accuracy requirements, which is an important attribute of data quality and is a direct target of many cyberattacks. Given the impact of instrumentation channels on the quality, they have been well-characterized and evaluated for impacts on accuracy in the literature. The errors induced by them could be rectified through model-based correction algorithms and state estimation based error filtering. Some other avenues where data quality could be evaluated include the cable configurations, testing and validating the devices to ensure accurate, consistent performance and interoperability at all levels pstt1 ; pstt2 . Although not explicit, these works hint at the improvement in the resilience of synchrophasor devices against potentially malicious activities by accounting for proper testing methods to characterize and evaluate the different sources of errors prior to deployment that might contribute to poor quality.
|Cyber-attack||Quality Affected||Quality Check Looks For||Mitigation Methods Using Quality|
|Device tampering (delay/loss, theft)
exploringchallenges ; synchsec
|Completeness, plausibility, accuracy, consistency, origination||Large gap sizes, inaccurate readings, ping fail||
|Spoofing PMU data (manipulation)
fdi2 ; dataspoof ; dataspoof2
|Consistency, accuracy, plausibility||Unexpected values, errors, mismatch with SCADA values, redundant timestamp, out-of-order packet arrival||
|GPS Spoofing (manipulation, delay/loss)
gpsspoof ; eval3 ; gpsspoofing1 ; gpsspoofing2
|Consistency, origination, plausibility||Inaccurate timing value, TVE , packets arrive out-of-order||
|Denial of Service (delay/loss)
|Completeness, accuracy, consistency||Congestion at PDCs/network, delayed arrival of packets, dropped packets, inability to reach suspected device||
|Man-in-the-Middle (delay/loss, manipulation, theft)
|Origination, accuracy, availability, consistency||Mismatch between obtained and expected value, abnormal delay in packet arrival||
|False Data Injection (manipulation, theft)
fdi1 ; fdi3 ; fdi4 ; fdi5 ; fdi6
|Plausibility, consistency, accuracy, origination||Mismatch with SCADA values, unexpected values, spatio-temporal outliers||
|Snooping, Sniffing (theft)
synchsec ; beasley
|Plausibility, origin||No observable changes- additional analysis needed||
synchsec ; beasley
|Completeness, consistency, availability, accuracy||Observable patterns in gaps, slow arrival of packets||
|APT, Insider threat (delay/loss, theft, manipulation) human||Accuracy, consistency, origin, plausibility||No observable changes- additional analysis needed||
Final conclusions can be gathered from eval7 . The report by the Pacific Northwest National Laboratory (PNNL) analyzes existing synchrophasor networks in terms of their communication and information-level interoperability, security and performance. It concluded that latency is a key issue for the future synchrophasor designs which is expected to compound latency due to PDC functionality. It also emphasized that substations generally did not employ redundancy; there is little consistency in adoption of security methods for synchrophasor networks. Some tools include link-level encryption, virtual private networks (VPNs), ID/IPS, firewalls and access control lists (ACLs). Further, existing data quality checking methods locate a compromise in integrity by identifying faulted data values (due to measurement errors, communication delays or external events) but not due to result of device tampering, MITM, spoofing or FDI. Since both faults and attacks have the same impact on quality, it is important to differentiate the two causes while checking for the attributes such as accuracy, consistency and timeliness.
To summarize, the following measures can be used as metrics to quantify data quality: TVE, errors in magnitude, phase, frequency and ROCOF, harmonics and noise for measurement accuracy; comparison between measured and expected results, confidence interval and precision for measurement specifiers; temporal, geospatial and topological accuracy for attribute accuracy; device model specifications, geospatial and topological coordinates, coverage and content for origination; persistence in Header and Data frames, standards compliance, reporting rate and order for logical consistency; and gap rate, gap size and largest known gap for completeness. Benchmarking and standardization are two methods that can be used to evaluate data quality. Similarly, cybersecurity can be quantified by conducting extensive penetration testing of the synchrophasor networks integrated into benchmarked IEEE bus systems for different types of attacks (DoS, MITM, FDI, spoofing, probing, cache poisoning) and discovering potential vulnerabilities that could be exploited. While doing so, it would be important to also repeat the evaluation of the quality attributes using the above metrics and explore how they are impacted due to the specific attacks, and whether they violate the industry standards requirements specified for different applications.
4.2 Addressing Cyber-attacks Using Quality Issues
It can be seen from Table 7 that successful cyberattacks compromise synchrophasor data quality since the security requirements are violated cybersecreq . Given synchrophasors use TCP/UDP on the transport layer for their communications, attacks typically possible on TCP/IP stack like DoS, MITM, packet replay or spoofing are possible in synchrophasor domains as well.
Physical attacks like device tampering causes loss or incurs theft of critical information, easily observed through large gaps sizes, poor accuracy in obtained values and unreliable origin. The lost data is typically handled through substitution, either statistical or intelligent exploringchallenges ; synchsec . The best way to prevent physical attacks like cable disconnects, direct damage to device, etc. is by ensuring the devices are isolated from external weather and human elements.
Spoofing synchrophasor data is achievable through polynomial fitting or data mirroring techniques. Such attacks impact quality that manifests as outliers or noise. Several methods have been proposed to counter these attacks: intra-PMU and inter-PMU correlations to determine the relationship between PMU parameters and across PMUs in a locality, respectively; machine learning techniques like Support Vector Machines (SVMs) and morefdi2 ; dataspoof ; dataspoof2 .
GPS spoofing exploits publicly available civilian GPS signals using air or cable to produce signals that initially align with the original, but slowly start increasing the power to drown the authentic signal and thereby compromising the receiver gpsspoof ; eval3 . By introducing measurement errors in the time synchronization, the attacks induce changes in data consistency and plausibility which can be used as markers to identify the likelihood of the attack gpsspoofing1 ; gpsspoofing2 ; yuder .
In a successful DoS where multiple synchrophasor devices get compromised, packet delay or loss is observed. This impact in quality can serve a clue to the onset of DoS-style attacks. Typical solutions involve augmenting inline blocking tools, high bandwidth connections, disabling IP broadcasts and port hardening.
MITM is possible in synchrophasors where the attacker acts as a legitimate PDC to the PMUs and vice-versa, thereby intercepting and/or modifying all messages exchanged. This is noticed by quality checking methods in the form of poor accuracy and consistency in values between what was sent by PMU and what was received by PDC. It can be avoided by having the devices employ mutual authentication and a digital certificate mechanism with an actively managed Certificate Revocation Lists (CRLs) and certificate authorities synchsec ; beasley .
FDI impacts the consistency, accuracy and plausibility of the data. The effects are typically observed as spatio-temporal outliers in the data. Quality checking methods check for this anomaly and may employ correlation across different timestamps to identify the corruption of data. FDI is one of the widely explored attacks on synchrophasor domain, with solutions like determining the mismatch between the values obtained from PMUs and that observed in SCADA, monitoring the line impedances which get affected when data is manipulated, and using density-based Local Outlier Filter (LOF) analysis fdi1 ; fdi3 ; fdi4 ; fdi5 ; fdi6 .
Sometimes, attackers simply capture the packets flowing in a channel with an intent to listen. Such sniffing/snooping attacks have been conducted using WireShark to realize messages are exchanged in plaintext. This attack is difficult to detect using data quality checking methods since most often, no quality characteristic is impacted as the attackers do not affect the data actively. However, technologies like VPN, encryption of selective messages (to reduce the overall process overhead), or Transport Layer Security (TLS)/Secure Socket Layer (SSL), Secure Shell (SSH) can be used to mitigate them. While TLS has been shown to be susceptible to poisoning attacks and VPN to side channel attacks, careful network design can account for them synchsec ; snooping .
With the increased frequency of campaign efforts and nation-sponsored attacks against the grid, synchro-phasors could be lucrative targets for sophisticated attacks like advanced persistent threats (APTs), social engineering, watering-hole attacks and malware-based intrusions tong ; flau ; lanchao ; jzhang ; hastings . While these attacks scale beyond specific devices in the synchrophasor hierarchy, the quality checking methods alone would not be sufficient human . The use of defense-in-depth model augmented with stakeholder interactions, awareness and training, and intelligent solutions like machine learning for attack data classification and/or event prediction, root-cause analysis of observed events, developing evolving defense topographies using moving target defense, and advanced visualization techniques for efficient cognition of events would play a critical role.
The key takeaway from this section is that impacts on data quality can provide strong markers for an underlying cyber-attack. Noise, outliers and missing values are all commonly observed issues which quality checking methods may be programmed to detect, analyze and base decisions on. Certain sophisticated attacks like APTs, insider threats, sniffing, and social engineering have indirect impacts on quality which a checking method may not be able to detect with enough confidence or precision. Additional solutions are required to mitigate such attacks in the synchrophasor domain. These solutions include statistical methods like divergence, correlation, regression and substitution; intelligent methods like neural networks and evolutionary algorithms for event classification and prediction, logistic regression for substitution; technologies like VPNs, firewalls, ID/IPS, anomaly detectors, selective encryption, port hardening, network isolation and use of TLS/SSL, SSH; and human-in-the-loop solutions like advanced visualization techniques, awareness and training, and stakeholder engagements. While the impacts on quality can also be due to underlying device or measurement errors, most of the works in the literature assume the data has been subject to delay/loss, manipulation or theft intentionally. This paves way for the recommendation that the upcoming research in this area must look at ways to differentiate the impacts on data quality due to attacks from errors.
5 Future Directions of Research and Conclusion
The future directions of research in the areas of synchrophasor data quality, cybersecurity and communications are multi-faceted. Addressing data quality challenges must begin with a strong push to the adoption of industry-wide, vendor-agnostic data management, processing and storage standards for smart grid. Most recent cyber-attacks were successful due to the difference in speed of cognition of the information generated by automated vulnerability detection tools and the speed with which the machine data is created (called cognitive gap) human . The design of synchrophasor devices are also expected to improve in the future smartcity . Keeping in mind the quality challenges, an improvement to PDC design called flexible integrated synchrophasor system (FIPS) was proposed to minimize issues in quality and communication, and tackles specific tasks of PDC such as data alignment, employs cryptographic methods to ensure confidential exchange of data without jeopardizing integrity, and establishes relevance to the NASPInet flexpdc . To ensure device and application-level interoperability, development of technical standards and conformance testing rules is expected. Further, the emergence of distribution-level PMUs will evoke the need for developing measurement, communication, quality and security standards. Further, with the deployment of distributed renewable sources, electric and autonomous vehicles, energy storage and transactive energy, there is a strong impetus for enhancing technologies behind monitoring and control, of which synchrophasors will play a major role eval2 .
To conclude, while existing research has focused on the synchrophasor challenges of quality and cybersecurity individually, their interdependency has largely been ignored. This paper makes one of the first attempts at highlighting the impacts of cyber-attacks on various quality attributes, thereby recommending that the future research on the design and development of security solutions should account for their impacts on quality as well, and that different quality characteristics can be used by quality checking methods to flag for potential cyber-attacks. Plausibility, completeness, accuracy and consistency are some of the attributes that are most adversely impacted by a majority of the attacks on synchrophasors. At the same time, not all cases of poor data quality imply a successful cyber-attack as the reason. Different metrics that could be used to quantify quality attributes were summarized, and the methods that help evaluate the impacts of quality and security on performance were also briefly highlighted. This paper serves as a starting point for researchers entering these areas as it summarizes and determines their interdependency and relevance to smart grid security.
This material is based on work supported by the National Science Foundation Grant No. CNS-1553494 and the Department of Energy Grant No. 800006104. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF and DOE.
- (1) Ozgur U, Nair HT, Sundararajan A, et al (2017) An Efficient MQTT Framework for Control and Protection of Networked Cyber-Physical Systems. IEEE Conference on Communications and Network Security, Las Vegas, NV, USA, October 9-11, 2017, 421-426, doi: 10.1109/CNS.2017.8228674
- (2) Sanjab A, Saad W, Guvenc I, et al (2016) Smart Grid Security: Threats, Challenges, and Solutions. arXiv:1606.06992 [cs.IT]
- (3) Sundararajan A, Pons A, Sarwat AI (2015) A Generic Framework for EEG-Based Biometric Authentication. In: Proceedings of the 12th International Conference on Information Technology – New Generations, Las Vegas, NV, USA, April 13-15, 2015, 139-144, doi: 10.1109/ITNG.2015.27
- (4) Anzalchi A, Sarwat A (2015) A survey on security assessment of metering infrastructure in Smart Grid systems. IEEE SoutheastCon, Fort Lauderdale, FL, USA, April 9-12, 2015, doi: 10.1109/SECON.2015.7132989
- (5) Dagle JE (2004) Data Management Issues Associated with the August 14th, 2003 Blackout Investigation. In: Proceedings of IEEE Power Engineering Society General Meeting, Denver, CO, USA, June 6-10, 2004, 1-5, doi: 10.1109/PES.2004.1373160
- (6) Larsson S, Ek E (2004) The Blackout in Southern Sweden and Eastern Denmark, September 23, 2003. In: Proceedings of IEEE Power Engineering Society General Meeting, Denver, CO, USA, October 29-November 1, 2006, 309-313, doi: 10.1109/PSCE.2006.296324
- (7) Corsi S, Sabelli C (2004) General Blackout in Italy Sunday September 28th, 2003, h 03:28:00. In: Proceedings of IEEE Power Engineering Society General Meeting, Denver, CO, USA, June 6-10, 2004, 1-12, doi: 10.1109/PES.2004.1373162
- (8) Berizzi A (2004) The Italian 2003 Blackout. In: Proceedings of IEEE Power Engineering Society General Meeting, Denver, CO, USA, June 6-10, 2004, 1-7, doi: 10.1109/PES.2004.1373159
- (9) Gomes P (2004) New Strategies to Improve Bulk Power Systems Security: Lessons Learned from Large Blackouts. In: Proceedings of IEEE Power Engineering Society General Meeting, Denver, CO, USA, June 6-10, 2004, 1-6, doi: 10.1109/PES.2004.1373163
- (10) Imai S (2004) TEPCO observations on August 14 blackout and recommendations to prevent future blackouts based on TEPCO’s experience. In: Proceedings of IEEE Power Engineering Society General Meeting
- (11) Jamei M, Sarwat AI, Iyengar SS, et al (2015) Security Breach Possibility with RSS-Based Localization of Smart Meters Incorporating Maximum Likelihood Estimator. In: Selvaraj H, Zydek D, Chmaj G (eds) Progress in Systems Engineering. Advances in Intelligent Systems and Computing, vol 366, Springer, Cham, doi: 10.1007/978-3-319-08422-0-20
- (12) Wei L, Sarwat AI, Saad W (2016) Risk assessment of coordinated cyber-physical attacks against power grids: A stochastic game approach. IEEE Industry Applications Society Annual Meeting, Portland, OR, USA, 1-7, doi: 10.1109/IAS.2016.7731849
- (13) Hauer JF, Bhatt NB, Shah K, et al (2004) Performance of ”WAMS East” in providing dynamic information for the North East blackout of August 14, 2003. In: Proceedings of the 2004 IEEE Power and Energy Society general meeting, Denver, CO, USA, June 6-10, 2004, 1-6, doi: 10.1109/PES.2004.1373161
- (14) U.S.-Canada Power System Outage Task Force (2004) Final Report on the August 14, 2003 Blackout in the United States and Canada: Causes and Recommendations. North American Electric Reliability Commission (NERC) Report, accessed from: https://www.energy.gov/sites/prod/files/oeprod/ DocumentsandMedia/Outage_Task_Force_-_DRAFT_Report_on_Implementation.pdf, access date: October, 2017
- (15) Zima M, Larsson M, Korba P, et al (2005) Design aspects for wide-area monitoring and control system. Proceedings of the IEEE 93(5):980-996, doi: 10.1109/JPROC.2005.846336
- (16) Wei L, Sarwat A, Saad W, Biswas S (2014) Stochastic Games for Power Grid Protection Against Coordinated Cyber-Physical Attacks. IEEE Transactions on Smart Grid PP(99):1-1, doi: 10.1109/TSG.2016.2561266
- (17) Ashton PM, Taylor GA, Irving MR, et al (2012) Prospective wide area monitoring of the Great Britain transmission system using phasor measurement units. In: Proceedings of IEEE Power Engineering Society General Meeting, July 22-26, 2012, 1-8, doi: 10.1109/PESGM.2012.6345306
- (18) Chow JH, Beard L, Patel M, et al (2015) Guidelines for Siting Phasor Measurement Units. North American SynchroPhasor Initiative Research Initiative Task team (NASPI-RITT) Report, accessed from: https://www.researchgate.net/publication/279658581 _Guidelines_for_Siting_Phasor_Measurement_Units_Version _8_June_15_2011_North_American_SynchroPhasor_Initiative _NASPI_Research_Initiative_Task_Team_RITT_Report
- (19) Gomes P, Martins N, de Mello P, et al (1998) Assuring System Reliability in a Competitive Environment. In: Proceedings of CIGRE Meeting
- (20) de Azevedo R, Allen D, Perpuly Y, et al (2015) PMU placement considering data uncertainty and redundancy. IEEE SoutheastCon, Fort Lauderdale, FL, USA, April 9-12, 2015, 1-5, doi: 10.1109/SECON.2015.7133034
- (21) Parvez I, Islam A, Kaleem F (2014) A key management-based two-level encryption method for AMI. IEEE PES General Meeting — Conference & Exposition, National Harbor, MD, USA, jULY 1, 2014, 1-5, doi: 10.1109/PESGM.2014.6939551
- (22) Wang Y, Saad W, Sarwat AI, et al (2017) Reactive Power Compensation Game under Prospect-Theoretic Framing Effects. IEEE Transactions on Smart Grid, 99:1-1, doi: 10.1109/TSG.2017.2652846
- (23) Ma J, Zhang P, Fu HJ, et al (2010) Application of Phasor Measurement Unit on Locating Disturbance Source for Low-Frequency Oscillation. IEEE Transactions on Smart Grid, 1(3):340-346, doi: 10.1109/TSG.2010.2071889
- (24) Narendra K (2007) Role of Phasor Measurement Unit (PMU) in Wide Area Monitoring and Control. ERL Phase Power Technologies Report, accessed from: http://www.erlphase.com/downloads/application_notes/ Roles_of_PMUs_in_Wide_Area_Monitoring_and_Control.pdf
- (25) Novosel D, Vu K (2006) Benefits of PMU Technology for Various Applications. International Council on Large Electric systems- Cigre Croatian National Committee, 7th Symposium on Power System Management, November 5-8, 2006, Cavtat, accessed from: https://www.ieee.hr/_download/repository/Pozivno _predavanja_Novosel_Vu_Cigre_06.pdf
- (26) Ferrari L, Gentz R, Scaglione A, et al. (2014) The pulse coupled phasor measurement units. IEEE International Conference on Smart Grid Communications (SmartGridComm), Venice, Italy, November 3-6, 2014, 320-325, doi: 10.1109/SmartGridComm.2014.7007666
- (27) Sreenivasareddy PS, Chowdhury SP, Chowdhury S (2010) PMU Placement- A Comparative Survey and Review. IET International Conference on Developments in Power System Protection, Manchester, UK, March 29-April 1, 2010, 1-4, doi: 10.1049/cp.2010.0326
- (28) Aamre K, Centeno VA, Pal A (2015) Unified PMU Placement Algorithm for Power Systems. North American Power Symposium (NAPS), Charlotte, NC, October 4-6, 2015, 1-6, doi: 10.1109/NAPS.2015.7335254
- (29) Parvez I, Sarwat AI, Wei L, Sundararajan A (2016) Securing Metering Infrastructure of Smart Grid: A Machine Learning and Localization Based Key Management Approach. MDPI Journal of Energies 9(9), doi: 10.3390/en9090691
- (30) Parvez I, Jamei M, Sundararajan A, Sarwat AI (2014) RSS based loop-free compass routing protocol for data communication in advanced metering infrastructure (AMI) of Smart Grid. In: Proceedings of 2014 IEEE Symposium on Computational Intelligence Applications in Smart Grid (CIASG), Orlando, FL, USA, December 9-12, 2014, 1-6, doi: 10.1109/CIASG.2014.7011570
Negash K, Khan B, Yohannes E (2016) Artificial Intelligence Versus Conventional Mathematical Techniques: A Review for Optimal Placement for Phasor Measurement Units. Technological Economic Smart Grids Sustainable Energy, doi: 10.1007/s40866-016-0009-y
- (32) Rahman NHA, Zobaa AF (2016) Optimal PMU Placement using topology transformation method in power systems. Journal of Advanced Research, 7:6-625-634, doi: 10.1016/j.jare.2016.06.003
Nazari-Heris M, Mohammed-Ivatloo B (2016) Application of heuristic algorithms to optimal PMU placement in electric power systems: An updated review. Renewable and Sustainable Energy Reviews 50:214-228, doi: 10.1016/j.rser.2015.04.152
- (34) Chouhan D, Jaiswal V (2016) A Literature Review on Optimal Placement of PMU and Voltage Stability. Indian Journal of Science & Technology, 9(47):1-7, doi: 10.17485/ijst/2016/v9i47/101724
- (35) Meier A, Stewart E, McEachern A, et al (2017) Precision Micro-Synchrophasors for Distribution Systems: A Summary of Applications. IEEE Transactions on Smart Grid. 8:2926-2936, doi: 10.1109/TSG.2017.2720543
- (36) Sexauer J, Javanbakht P, Mohaghehi S (2013) Phasor Measurement Units for the Distribution Grid: Necessity and Benefits. In: Proceedings of IEEE PES Innovative Smart Grid Technologies, Washington DC, February 24-27, 2013, 1-7, doi: 10.1109/ISGT.2013.6497828
- (37) Singh B, Sharma NK, Tiwari AN, et al (2011) Applications of Phasor Measurement Units (PMUs) in electric power system networks incorporated with FACTS controllers. International Journal of Engineering, Science and Technology 3(3):64-82, accessed from: https://www.ajol.info/index.php/%EE%80%80ijest%EE% 80%81/article/viewFile/68423/56504
- (38) Sanchez-Ayala G, Aguerc JR, Elizondo D, et al (2013) Current trends on applications of PMUs in distribution systems. In: Proceedings of IEEE PES Innovative Smart Grid Technologies (ISGT), Washington DC, February 24-27, 2013, doi: 10.1109/ISGT.2013.6497923
- (39) Lee H, Tushar, Cui B, et al (2017) A review of synchrophasor applications in smart grid. WIREs Energy Environ, 6(3):1-31, doi: 10.1002/wene.223
- (40) Lauby M (2010) Real-time Application of PMUs to Improve Reliability Task Force (RAPIR TF). NERC Technical Presentation, accessed from: https://www.nerc.com/comm/oc/related%20files%20dl /rapir_oc_slides.pdf
- (41) Mohanta DK, Murthy C, Roy DS (2016) A Brief Review of Phasor Measurement Units as Sensors for Smart Grid. Electric Power Components and Systems 44:411-425, doi: 10.1080/15325008.2015.1117538
- (42) NASPI PMU Applications Requirements Task Force White Paper (2017) PMU Data Quality: A Framework for the Attributes of PMU Data Quality and a Methodology for Examining Data Quality Impacts to Synchrophasor Applications. NASPI Technical Report, accessed from: https://www.naspi.org/sites/default/files/reference _documents/PARTF_WhitePaper_20170314_Final_PNNL _26313.pdf
- (43) Christoforidis GP, Meliopoulos APS (1990) Effects of Modeling on the Accuracy of Harmonic Analysis. IEEE Transactions on Power Delivery 5:1598-1607, doi: 10.1109/61.58006
- (44) Zhu F, Youssef A, Hamouda W (2016) Detection Techniques for Data-Level Spoofing in GPS-Based Phasor Measurement Units. International Conference on Selected Topics in Mobile & Wireless Networking (MoWNeT), Cairo, Egypt, April 11-13, 2016, doi: 10.1109/MoWNet.2016.7496634
- (45) Yang B, Yamazaki J, Saito N, et al (2015) Big Data Analytic Empowered Grid Applications- Is PMU a big data issue?. In: Proceedings of 12th International Conference on the European Energy Market (EEM), Lisbon, Portugal, May 19-22, 2015, doi: 10.1109/EEM.2015.7216718
- (46) Rahman NHA, Zobaa AF (2016) Optimal PMU placement using Topology transformation method In power systems. Journal of Advanced Research, 7(5):625-34, doi: 10.1016/j.jare.2016.06.003
- (47) Veda S, Chaudhuri NR, Baone CA, et al (2014) Assessment of Impact of Data Quality on PMU-Based Applications. CIGRE US National Committee Grid of the Future Symposium, accessed from: http://cigre-usnc.tamu.edu/wp-content/uploads/2015/06/Assessment-of-Impact-of-Data-Quality-on-PMU-Based-Applications.pdf
- (48) Zhu K (1988) A method for plausibility checks and data validation in power systems. IEEE Transactions on power systems, 3(1):267-271, doi: 10.1109/59.43210
- (49) Danielson CFM, Vanfretti L, Almas MS, Choompoobutrgool Y, Gjerde JO (2013) Analysis of communication network challenges for synchrophasor-based wide-area applications. Bulk Power System Dynamics and Control - IX Optimization, Security and Control of the Emerging Power Grid (IREP), 2013 IREP Symposium, Rethymno, Greece, August 25-30, 2013, doi: 10.1109/IREP.2013.6629379
- (50) Hu Y, Novosel D (2006) Challenges in Implementing a large-scale PMU System. Power System Technology PowerCon, Chongqing, China, October 22-26, 2006, doi: 10.1109/ICPST.2006.321829
- (51) Jones KD, Pal A, Thorp JS (2015) Methodology for Performing Synchrophasor Data conditioning and validation. IEEE transactions on Power Systems, 30(3):1121-1130, doi: 10.1109/TPWRS.2014.2347047
- (52) Huang C, Li F, Zhan L, et al (2016) Data quality issues for synchrophasor applications Part II: problem formulation and potential solutions. Journal of modern power systems and clean Energy, 4:353-361, doi: 10.1007/s40565-016-0213-8
- (53) Huang C, Li F, Zhan L, et al (2016) Data quality issues for synchrophasor applications Part I: a review. Journal of modern power systems and clean Energy, 4:342-352, doi: 10.1007/s40565-016-0217-4
- (54) Shepard DP, Humphreys TE (2012) Evaluation of the Vulnerability of Phasor Measurement Units to GPS Spoofing Attacks. Sixth Annual IFIP WG 11.10 International Journal on Critical Infrastructure Protection, 5:146-153, doi: 10.1016/j.ijcip.2012.09.003
- (55) Morris T, Pan S, Lewis J, et al (2011) Cybersecurity Testing of Substation Phasor Measurement Units and Phasor Data Concentrators. In: Proceedings of the Seventh Annual Workshop on Cyber Security and Information Intelligence Research, ACM New York, USA, Article 24, doi: 10.1145/2179298.2179324
- (56) Hao Y, Wang M, Chow J (2015) Likelihood of Cyber Data Injection Attacks to Power Systems. Signal and Information Processing (GlobalSIP), IEEE Global Conference on, Orlando, FL, USA, December 14-16, 2015, doi: 10.1109/GlobalSIP.2015.7418278
- (57) Kumar S, Soni MK, Jain DK (2015) Cyber Security Threats in Synchrophasor System in Wide Area Monitoring System. TELKOMNIKA Indonesian Journal of Electrical Engineering, 15(3):436-444, doi: 10.11591/ijeecs.v15.i3.pp436-444
- (58) Lin H, Deng Y, Shukla S, et al (2012) Cyber security impacts on all-PMU state estimator-a case study on co-simulation platform GECO. In: Proceedings of IEEE Third International Conference on Smart Grid Communications (SmartGridComm), Tainan, Taiwan, November 5-8, 2012, doi: 10.1109/SmartGridComm.2012.6486049
- (59) Beasley CT (2014) Electric power synchrophasor network cyber security vulnerabilities. Master’s Dissertation, Clemson University, accessed from: https://tigerprints.clemson.edu/cgi/viewcontent.cgi?article =2995&context=all_theses
- (60) Rizzetti TA, Canha LN, Milbradt R, et al (2015) Security Aspects on PMU data communication Based on IP Networks in Smart Grids. In: Proceedings of 23rd International Conference on Electricity Distribution, Lyon, June 15-18, 2015, accessed from: http://cired.net/publications/cired2015/papers/CIRED 2015_1477_final.pdf
- (61) Saxena N, Choi BJ (2015) State of the Art Authentication, Access Control, and Secure Integration in Smart Grid. MDPI Journal of Energies, 8(10):11883-11915, doi: 10.3390/en81011883
- (62) Deng Y, Shukla S (2012) Vulnerabilities and Countermeasures – A Survey on the Cyber Security Issues in the Transmission Subsystem of a Smart Grid. Journal of Cyber Security and Mobility, accessed from: https://www.semanticscholar.org/paper/Vulnerabilities-and-Countermeasures-%E2%80%93-A-Survey-on-a-Deng-Shukla/6c4b97cc4f70fb34cad8c2b03f7fb5dfb8a5e84d
- (63) Pan S (2014) Cybersecurity testing and intrusion detection for cyber-physical power systems. PhD Dissertation, Mississippi State, accessed from: https://search.proquest.com/docview/1640913316?pq-origsite=gscholar
- (64) Ashok A, Hahn A, Govindarasu M (2014) Cyber-physical security of Wide-Area Monitoring, Protection and Control in a smart grid environment. Journal of Advanced Research, 5(4):481-489, doi: 10.1016/j.jare.2013.12.005
- (65) Adhikari U, Morris T, Pan S (2016) WAMS Cyber-Physical Test Bed for Power System, Cybersecurity Study, and Data Mining. IEEE Transactions in Smart Grid, 8(6):2744-2753, doi: 10.1109/TSG.2016.2537210
- (66) Paudel S, Smith P, Zseby T (2016) Data Integrity Attacks in Smart Grid Wide Area Monitoring. In: Proceedings of the 4th International Symposium for ICS & SCADA Cyber Security Research, Queen’s Belfast University, UK, 74-83, doi: 10.14236/ewic/ICS2016.9
- (67) Akyol BA (2012) Cyber Security Challenges in Using Cloud Computing in the Electric Utility Industry. DOE Technical Report by Pacific Northwest National Laboratory (PNNL), accessed from: https://www.pnnl.gov/main/publications/external/ technical_reports/PNNL-21724.pdf
- (68) Weekes MA, Hydro M, Hydro KWM (2007) PMU Challenges and Performance Issues. In: Proceedings of the IEEE Power Engineering Society General Meeting, Tampa, FL, USA, June 24-28, 2007, doi: 10.1109/PES.2007.386004
- (69) Song H, Wu J, Wu K (2014) A Wide-Area Measurement Systems-Based Adaptive Strategy for Controlled Islanding in Bulk Power Systems. MDPI Journal of Energies, 7(4):2631-2657, doi: 10.3390/en7042631
- (70) Johnson A (2017) Standards Associated with Synchrophasors. IEEE PES General Meeting Presentation, accessed from: https://www.naspi.org/sites/default/files/2017-03/01_sce_johnson_Standards_Associated_with _Synchrophasors_20161019.pdf
- (71) Martin K (2015) Synchrophasor Measurements Under the IEEE Standard C37.118.1-2011 With Amendment C37.118.1a. IEEE Transactions on Power Delivery, 30(3):1514-1522, doi: 10.1109/TPWRD.2015.2403591
- (72) Ali I, Aftab MA, Hussain SMS (2016) Performance comparison of IEC 61850-90-5 and IEEE C37.118.2 based wide area PMU communication networks. Journal of Modern Power Systems Clean Energy (MPCE), 4(3):487-495, doi: 10.1007/s40565-016-0210-y
- (73) Retty HA (2013) Evaluation and Standardizing of Phasor Data Concentrators. Master’s Thesis, Virginia Polytechnic Institute and State University, accessed from: http://hdl.handle.net/10919/32064
- (74) Premerlani WJ, Kasztenny BZ, Adamiak MG (2006) System and Method for Synchronized Phasor Measurement. United States Patent Application Publication, US 2006/0247874 A1, accessed from: https://patents.google.com/patent/US7444248
- (75) (2011) IEEE Standard for Synchrophasor Data Transfer for Power Systems. IEEE Power and Energy Society Standard, published on December 28, 2011, doi: 10.1109/IEEESTD.2011.6111222
- (76) Phadke AG, Thorp JS (2017) Synchronized Phasor Measurements and Their Applications. Springer Science+Business Media, Edition 2, accessed from: https://www.springer.com/us/book/9783319505824
- (77) Rihan M, Ahmed M, Beg MS (2011) Phasor measurement units in the Indian smart grid. In: Proceedings of IEEE Conference on Innovative Smart Grid Technologies India (ISGT India), Kollam, Kerala, India, December 1-3, 2011, doi: 10.1109/ISET-India.2011.6145392
- (78) NASPI Time Synchronization Task Force (2017) Time Synchronization in the Electric Power System. NASPI Technical Report, accessed from: https://www.naspi.org/sites/default/files/reference _documents/tstf_electric_power_system_report_pnnl_26331 _march_2017_0.pdf
- (79) (2006) IEEE Standard for Synchrophasors for Power Systems. IEEE Power and Energy Society Standard, accessed from: https://ieeexplore.ieee.org/document/1611105/, doi: 10.1109/IEEESTD.2006.99376
- (80) Kezunovic M, Dutta P (2011) The Role of Data Exchange Standards in Developing Automated Fault Disturbance Monitoring. In: Proceedings of 6th International Workshop on Deregulated Electricity Market Issues in South-Eastern Europe (DEMSEE), 1-6, accessed from: https://pdfs.semanticscholar.org/f8c3/8c8d8aac32b6cb fa1d84948db977fc8d6a8e.pdf
- (81) (2011) IEEE Standard for Synchrophasor Measurements for Power Systems. IEEE Power and Energy Society Standard, accessed from: https://ieeexplore.ieee.org/document/6111219/, doi: 10.1109/IEEESTD.2011.6111219
- (82) (2014) IEEE Guide for Phasor Data Concentrator Requirements for Power System Protection, Control, and Monitoring. IEEE Power and Energy Society Standard, accessed from: https://ieeexplore.ieee.org/document/6514039/, doi: 10.1109/IEEESTD.2013.6514039
- (83) Chai J, Liu Y, Guo J, et al (2016) Wide-area Measurement Data Analytics Using FNET/GridEye: A Review. Power Systems Computation Conference, Genoa, Italy, June 20-24, 2016, doi: 10.1109/PSCC.2016.7540946
- (84) Eissa MM, El-Mesalawy MM, Liu Y, et al (2012) Wide Area Synchronized Frequency Measurement System Architecture with Secure Communication for 500kV/220kV Egyptian Grid. IEEE International Conference on Smart Grid Engineering (SGE‘12), Oshawa, Canada, August 27-29, 2012, doi: 10.1109/SGE.2012.6463967
- (85) Liu Y (2014) FNET/GridEye. Technical Document of Oak Ridge National Laboratory, accessed from: https://web.ornl.gov/sci/renewables/docs/factsheets/FNET-GridEye-Factsheet.pdf
- (86) Stenbakken G, Zhou M (2007) Dynamic Phasor Measurement Unit Test System. In: Proceedings of IEEE Power Engineering Society General Meeting, Tampa, FL, USA, June 24-28, 2007, doi: 10.1109/PES.2007.386139
- (87) Wang L, Burgett J, Zuo J, et al (2007) Frequency Disturbance Recorder Design and Developments. In: Proceedings of IEEE Power Engineering Society General Meeting, Tampa, FL, USA, June 24-28, 2007, doi: 10.1109/PES.2007.385880
- (88) Wang L (2010) Next Generation Frequency Disturbance Recorder Design and Timing Analysis. Doctor of Philosophy Dissertation Thesis Report, Virginia Polytechnic Institute and State University, accessed from: http://hdl.handle.net/10919/77096
- (89) Culliss JA (2015) A 3rd Generation Frequency Disturbance Recorder: A Secure, Low Cost Synchrophasor Measurement Device. PhD Dissertation, University of Tennessee, accessed from: https://trace.tennessee.edu/utk_graddiss/3495/
- (90) IEEE Power and Energy Society (2013) IEEE Standard for Intelligent Electronic Devices Cyber Security Capabilities. IEEE Power and Energy Society Standard, doi: 10.1109/IEEESTD.2014.6704702
- (91) IEEE Power and Energy Society (2014) IEEE Standard Cybersecurity Requirements for Substation Automation, Protection, and Control Systems. IEEE Power and Energy Society Standard, doi: 10.1109/IEEESTD.2015.7024885
- (92) IEEE Power and Energy Society (2011) IEEE Trial-Use Standard for a Cryptographic Protocol for Cyber Security for Substation Serial Links. IEEE Power and Energy Society Standard, doi: 10.1109/IEEESTD.2011.5715000
- (93) Firouzi SR, Hooshyar H, Mahmood F, et al (2016) An IEC 61850-90-5 Gateway for IEEE C37.118.2 Synchrophasor Data Transfer. In: Proceedings of 6th NASPI-ISGAN International Synchrophasor Symposium, Boston, MA, USA, July 17-21, 2016, doi: 10.1109/PESGM.2016.7741393
- (94) Mackiewicz R (2006) Overview of IEC 61850 and Benefits. IEEE PES Power Systems Conference and Exposition, Atlanta, GA, October 29-November 1, 2006, doi: 10.1109/PSCE.2006.296392
- (95) International Electrotechnical Commission (2013) Common format for transient data exchange (COMTRADE) for power systems. IEC 60255-24 Part 24, doi: 10.1109/IEEESTD.2013.6512503
- (96) SGIP (2010) Introduction to NISTIR 7628 Guidelines for Smart Grid Cyber Security. The Smart Grid Interoperability Panel Cyber Security Working Group Report, accessed from: https://www.smartgrid.gov/files/nistir_7628_.pdf
- (97) Sun CC, Liu CC, Xie J (2016) Cyber-Physical System Security of a Power Grid: State-of-the-Art. MDPI Journal of Electronics, 5(3):40, doi: 0.3390/electronics5030040
- (98) Mehta H (2011) Will the current set of ‘standards’ assure measurement subsystem interoperability?. NASPI PSTT Meeting Report
- (99) Pacific Northwest National Laboratory, National Institute of Standards & Technology Team (2017) Synchrophasor Data Quality Attributes and a Methodology for Examining Data Quality Impacts Upon Synchrophasor Applications – Overview. NASPI Technical Report, accessed from: https://www.nist.gov/publications/synchrophasor-data-quality-attributes-and-methodology-examining-data-quality-impacts
- (100) (2013) IEEE Guide for Synchronization, Calibration, Testing, and Installation of Phasor Measurement Units (PMUs) for Power System Protection and Control. IEEE Power and Energy Society Standard, doi: 10.1109/IEEESTD.2013.6475134
- (101) (2010) IEEE Standard for Common Format for Event Data Exchange (COMFEDE) for Power Systems. IEEE Power and Energy Society Standard, doi: 10.1109/IEEESTD.2010.5638582
- (102) Huang C, Li F, Zhou D, et al (2016) Data Quality Issues for Synchrophasor Applications Part I: A Review. Journal of Modern Power Systems and Clean Energy 4(3):342-352, doi: 10.1007/s40565-016-0217-4
- (103) Sarwat AI, Sundararajan A, Parvez I, et al (2018) Toward a Smart City of Interdependent Critical Infrastructure Networks. Sustainable Interdependent Networks, chapter 3, 21-45, doi: 10.1007/978-3-319-74412-4_3
- (104) Sarwat AI, Sundararajan A, Parvez I (2017) Trends and Future Directions of Research for Smart Grid IoT Sensor Networks. In: Proceedings of International Symposium on Sensor Networks, Systems and Security, Chapter 3, doi: 10.1007/978-3-319-75683-7_4
- (105) Aminifar F, Fotuhi-Firuzabad M, Safdarian A, et al 92014) Synchrophasor Measurement Technology in Power Systems: Panorama and State-of-the-Art. IEEE Access, 2:1607-1628, doi: 10.1109/ACCESS.2015.2389659
- (106) Zhang Y, Markham P, Xia T, et al (2010) Wide-Area Frequency Monitoring Network (FNET) Architecture and Applications, IEEE Transactions on Smart Grid 1(2):159-167, doi: 10.1109/TSG.2010.2050345
- (107) Yuill W, Edwards A, Chowdhury S, et al (2011) Optimal PMU placement: A comprehensive literature review. In: Proceedings of IEEE Power and Energy Society General Meeting, Detroit, MI, USA, July 24-29, 2011, doi: 10.1109/PES.2011.6039376
- (108) Manousakis NM, Korres GN, Georgilakis PS (2011) Optimal placement of phasor measurement units: A literature review. International Conference on Intelligent System Applications to Power Systems, Hersonissos, Greece, September 25-28, 2011, doi: 10.1109/ISAP.2011.6082183
- (109) NERC (2010) Real-Time Application of Synchrophasors for Improving Reliability. NERC Technical Report:1-77, accessed from: https://www.smartgrid.gov/document/real_time _application_synchrophasors_improving_reliability
- (110) NASPI PRSVTT, NASPI DNMTT Working Group (2016) Categorizing Phasor Measurement Units by Application Data Requirements. Draft Report, related article accessed from: https://www.naspi.org/sites/default/files/2016-09/naspi_prsvtt_report_20141023.pdf
- (111) Idaho National Laboratory (INL) (2016) Cyber Threat and Vulnerability Analysis of the U.S. Electric Sector. Mission Support Center Analysis Report, accessed from: https://www.energy.gov/sites/prod/files/2017/01/f34 /Cyber%20Threat%20and%20Vulnerability%20Analysis %20of%20the%20U.S.%20Electric%20Sector.pdf
- (112) Reinhard K, Pinte B, Kirihara K, et al (2015) Synchrophasor Data Quality Activity Research Update. Trustworthy Cyber Infrastructure for the Smart Grid, accessed from: https://tcipg.org/sites/default/files/rgroup/tcipg-reading-group-spring_2015_02-27_0.pdf
- (113) Sundararajan A, Khan T, Aburub H, et al (2018) A Tri-Modular Human-on-the-Loop Framework for Intelligent Smart Grid Cyber-Attack Visualization. IEEE Southeast Conference, Tampa, FL, April 18-22, 2018
- (114) Beasley C, Venayagamoorthy GK, Brooks R (2014) Cyber security evaluation of synchrophasors in a power system. Clemson University Power Systems Conference, Clemson, SC, USA, March 11-14, 2014, doi: 10.1109/PSC.2014.6808100
- (115) Stewart J, Maufer T, Smith R, et al (2011) Synchrophasor Security Practices. 14th Annual Georgia Tech Fault and Disturbance Analysis Conference, Atlanta, GA, USA, May 9-10, 2011, accessed from: https://cdn.selinc.com/assets/Literature/Publications/ Technical%20Papers/6449_SynchrophasorSecurity_EE_ 20100913_Web.pdf?v=20150812-082045
- (116) US Department of Energy (DOE) (2016) Advancement of Synchrophasor Technology in Projects Funded by the American Recovery and Reinvestment Act of 2009. Office of Electricity Delivery and Energy Reliability Report, accessed from: https://www.energy.gov/oe/downloads/advancement-synchrophasor-technology-projects-funded-american-recovery-and-reinvestment
- (117) Huang Z, Kasztenny B, Madani V, et al (2008) Performance Evaluation of Phasor Measurement Systems. IEEE Power Engineering Society General Meeting, Pittsburgh, PA, USA, July 20-24, 2008, doi: 10.1109/PES.2008.4596880
- (118) Stenbakken G, Huang H, Martin, K, et al (2007) PMU System Testing and Calibration Guide. Technical Report for the North American SynchroPhasor Initiative, Performance and Standard Task Team, accessed from: https://www.naspi.org/sites/default/files/reference _documents/pmu_system_test_guide_20071230.pdf
- (119) Meliopoulos S (2007) SynchroPhasor Measurement Accuracy Characterization. Technical Report for the North American SynchroPhasor Initiative, Performance and Standard Task Team, accessed from: https://www.naspi.org/node/657
- (120) Taft J (2018) Assessment of Existing Synchrophasor Networks. Pacific Northwest National Laboratory (PNNL) Technical Report, April 2018, accessed from: https://gridarchitecture.pnnl.gov/media/white-papers/Synchrophasor_net_assessment_final.pdf
- (121) Kumar S, Soni MK, Jain DK (2015) Cyber Security Threats in Synchrophasor System in WAMS. International Journal of Computer Applications, 115(8):17-22, doi: 10.1.1.695.2420
- (122) Oleka EU, Khanal A, Osareh AR, et al. (2015) Exploring the Challenging Issues with Synchrophasor Technology Deployments in Electric Power Grids. International Journal of Energy and Power Engineering, 9(9):1085-1088, doi: 10.1999/1307-6892/10002927
- (123) Esfahani MS (2014) Security Analysis of Phasor Measurement Units in Smart Grid Communication Infrastructures. Master’s Thesis, University of Nebraska-Lincoln, accessed from: http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article =1038&context=ceendiss
- (124) Landford J, Meier R, Barella R, et al. (2016) Fast Sequence Component Analysis for Attack Detection in Synchrophasor Networks. 5th International Conference on Smart Cities and Green ICT Systems (SMARTGREENS), Rome, Italy, April 23-25, 2016, accessed from: https://ieeexplore.ieee.org/document/7951353/
- (125) Pal S, Sikdar B, Chow J (2016) Detecting Data Integrity Attacks on SCADA Systems Using Limited PMUs. IEEE International Conference on Smart Grid Communications (SmartGridComm), Sydney, NSW, Australia, November 6-9, 2016, doi: 10.1109/SmartGridComm.2016.7778818
- (126) Pal S, Sikdar B (2014) A Mechanism for Detecting Data Manipulation Attacks on PMU Data. IEEE International Conference on Communication Systems, Macau, China, November 19-21, 2014, doi: 10.1109/ICCS.2014.7024804
- (127) University of Tennessee Knoxville (2012) Frequency Disturbance Recorder (FDR) Installation Guide. UT Knoxville User Guide Report, accessed from: https://powerit.utk.edu/fdr/FDRInstallAndConfigGuide .pdf
- (128) Fan X, Du L, Duan D (2017) Synchrophasor Data Correction under GPS Spoofing Attack: A State Estimation Based Approach. IEEE Transactions on Smart Grid, 9(5):4538-4546, doi: 10.1109/TSG.2017.2662688
- (129) Almas MS, Vanfretti L, Singh RS (2017) Vulnerability of Synchrophasor-based WAMPAC Applications’ to Time Synchronization Spoofing. 9(5):4601-4612, IEEE Transactions in Smart Grid, doi: 10.1109/TSG.2017.2665461
- (130) Yu DY, Ranganathan A, Locher T, et al (2014) Short paper: detection of GPS spoofing attacks in power grids. In: Proceedings of the 2014 ACM conference on Security and privacy in wireless & mobile networks, Oxford UK, July 23-25, 2014, doi: 10.1145/2627393.2627398
- (131) Aman MN, Sikdar B (2016) Detecting data tampering attacks in synchrophasor networks using time hopping. IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe), Ljubljana, Slovenia, October 9-12, 2016, doi: 10.1109/ISGTEurope.2016.7856326
- (132) Wu M, Xie L (2017) Online Detection of False Data Injection Attacks to Synchrophasor Measurements: A Data-Driven Approach. Proceedings of the 50th Hawaii International Conference on System Sciences, doi: 10.24251/HICSS.2017.389, accessed from: http://hdl.handle.net/10125/41544
- (133) Pal S, Sikdar B, Chow J (2017) Classification and Detection of PMU Data Manipulation Attacks Using Transmission Line Parameters. IEEE Transactions on Smart Grid, 9(5):5057-5066, doi: 10.1109/TSG.2017.2679122
- (134) Mao Z, Xu T, Overbye TJ (2017) Real-time Detection of Malicious PMU Data. 19th International Conference on Intelligent System Application to Power Systems (ISAP), San Antonio, TX, USA, September 17-20, 2017, doi: 10.1109/ISAP.2017.8071368
- (135) Zhang J, Chu Z, Sankar L, et al (2017) False Data Injection Attacks on Phasor Measurements That Bypass Low-rank Decomposition. IEEE International Conference on Smart Grid Communications (SmartGridComm), Dresden, Germany, October 23-27, 2017, doi: 10.1109/SmartGridComm.2017.8340729
- (136) Khan R, Albalushi A, McLaughlin K, et al. (2017) Model based Intrusion Detection System for Synchrophasor Applications in Smart Grid. IEEE Power & Energy Society General Meeting, Chicago, IL, USA, July 16-20, 2017, doi: 10.1109/PESGM.2017.8274687
- (137) Armenia A, Chow JH (2010) A Flexible Phasor Data Concentrator Design Leveraging Existing Software Technologies. IEEE Transactions on Smart Grid 1(1):73-81, doi: 10.1109/TSG.2010.2046509
- (138) Terzija V, Valverde G, Cai D, et al (2010) Wide-Area Monitoring, protection, and control of future electric power networks. Proceedings of IEEE, 99(1):80-93, doi: 10.1109/JPROC.2010.2060450
- (139) Cokkinides GJ, Miliopoulos APS, Stefopoulos G, et al (2007) Visualization and Characterization of Stability Swings via GPS-Synchronized Data. In: Proceedings of 40th Annual Hawaii International Conference on System Sciences, Waikoloa, HI, USA, January 3-7, 2007, doi: 10.1109/HICSS.2007.607
- (140) Stenbakken G, Nelson T (2007) Static Calibration and Dynamic Characterization of PMUs at NIST. In: Proceedings of IEEE Power Engineering Society General Meeting, Tampa, FL, USA, June 24-28, 2007, doi: 10.1109/PES.2007.385974
- (141) Zhu H, Shi Y (2014) Phasor Measurement Unit Placement for Identifying Power Line Outages in Wide-Area Transmission System Monitoring. In: Proceedings of 47th Hawaii International Conference on System Sciences, Waikoloa, HI, USA, January 6-9, 2014, doi: 10.1109/HICSS.2014.311
- (142) Maaß H, Cakmak HK, Bach F, et al (2015) Data processing of high-rate low-voltage distribution grid recordings for smart grid monitoring and analysis. EURASIP Journal on Advances in Signal Processing 73-81, doi: 10.1186/s13634-015-0203-4
- (143) Maass H, Cakmak HK, Süß W, et al (2013) First evaluation results using the new electrical data recorder for power grid analysis. IEEE Transactions on Instrumentation and Measurement 62(9):2384-2390, doi: 10.1109/TIM.2013.2270923
- (144) Wu H, Giri J (2006) PMU Impact on State Estimation Reliability for Improved Grid Security. In: Proceedings of 2005/2006 IEEE/PES Transmission and Distribution Conference and Exhibition, Dallas, TX, USA, May 21-24, 2006, doi: 10.1109/TDC.2006.1668709
- (145) Castello P, Ferrari P, Flammini A, et al (2015) A distributed PMU for electrical substations with wireless redundant process bus. IEEE Transactions on Instrumentation and Measurement 64(5):1149-1157, doi: 10.1109/TIM.2014.2363749
- (146) Dua D, Dambhare S, Gajbhiye RK, et al (2008) Optimal multistage scheduling of PMU placement: An ILP approach. IEEE Transactions on Power Delivery 23(4):1812-1820, doi: 10.1109/TPWRD.2008.919046
- (147) Tong Y (2015) Data Security and Privacy in Smart Grid. PhD Dissertation, University of Tennessee, accessed from: https://trace.tennessee.edu/utk_graddiss/3476
- (148) Lau F, Rubin SH, Smith MH, et al (2000) Distributed denial of service attacks. IEEE Inter-National Conference on Systems, Man, and Cybernetics, Nashville, TN, USA, October 8-11, 2000, doi: 10.1109/ICSMC.2000.886455
- (149) Liu L, Esmalifalak M, Ding Q, et al (2014) Detecting False Data Injection Attacks on Power Grid by Sparse Optimization. IEEE Transactions on Smart Grid 5(2):612-621, doi: 10.1109/TSG.2013.2284438
- (150) Zhang J, Domnguez-Garca AD (2014) On the failure of power system automatic generation control due to measurement noise. In: Proceedings of 2014 IEEE PES General Meeting & Conference Exposition, National Harbor, MD, USA, July 27-31, 2014, doi: 10.1109/PESGM.2014.6939464
- (151) Hastings J, Laverty Dm, Morrow DJ (2014) Securing the smart grid. Power Engineering Conference (UPEC), 49th International Universities, Cluj-Napoca, Romania, September 2-5, 2014, doi: 10.1109/UPEC.2014.6934753
- (152) Srivastava AK (2015) Meeting PMU Data Quality Requirements for Mission Critical Applications. PSERC Webinar, accessed from: https://pserc.wisc.edu/documents/general_information /presentations/pserc_seminars/announcements/2015 _webinars/Srivastava_PSERC_Webinar_Nov_2015 _Announcement.pdf
- (153) Zhu K (2013) Data Quality in wide-area Monitoring and control systems, PMU data Latency, Completeness, and Design of wide-Area Damping Systems. Master’s Thesis, KTH Royal Institute of Technology, accessed from: https://www.diva-portal.org/smash/get/diva2:649889/FULLTEXT01.pdf