- CachedRelayDescriptorReader - Class in org.torproject.metrics.collector.relaydescs
-
Parses all descriptors in local directory cacheddesc/ and sorts them
into directory structure in directory-archive/.
- call() - Method in class org.torproject.metrics.collector.cron.CollecTorMain
-
Wrapper for run
.
- check() - Method in class org.torproject.metrics.collector.relaydescs.ReferenceChecker
-
Checks references between descriptors, and if too many referenced
descriptors are missing, puts out a warning to the logs.
- checkAvailableSpace(Path) - Static method in class org.torproject.metrics.collector.cron.CollecTorMain
-
Checks the available space for the storage the given path is located on and
logs a warning, if 200 MiB or less are available, and otherwise logs
available space in TRACE level.
- cleanDirectory(Path) - Static method in class org.torproject.metrics.collector.persist.PersistenceUtils
-
Move temporary files to their final location.
- cleanDirectory(Path, long) - Static method in class org.torproject.metrics.collector.persist.PersistenceUtils
-
Clean up the given directory by deleting files that are older than the
given cut-off timestamp, and by moving temporary files to their final
location.
- cleanDirectory(Path, long, Path) - Static method in class org.torproject.metrics.collector.persist.PersistenceUtils
-
Clean up the given directory, excluding the given subdirectory, by
deleting files that are older than the given cut-off timestamp, and by
moving temporary files to their final location.
- cleanDirectory() - Method in class org.torproject.metrics.collector.sync.SyncPersistence
-
Cleans the directory in RecentPath
after storing descriptors.
- cleanUpDirectories() - Method in class org.torproject.metrics.collector.bridgepools.BridgePoolAssignmentsProcessor
-
Delete all files from the rsync (out) directory that have not been modified
in the last three days (seven weeks).
- cleanUpDirectories() - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Delete all files from the rsync (out) directory that have not been
modified in the last three days (seven weeks), and remove the .tmp
extension from newly written files.
- clear() - Method in class org.torproject.metrics.collector.conf.Configuration
-
clears all properties.
- CollecTorMain - Class in org.torproject.metrics.collector.cron
-
- CollecTorMain(Configuration) - Constructor for class org.torproject.metrics.collector.cron.CollecTorMain
-
- compress(byte[]) - Method in enum org.torproject.metrics.collector.webstats.FileType
-
Compresses the given bytes in memory and returns the compressed bytes.
- compress(OutputStream) - Method in enum org.torproject.metrics.collector.webstats.FileType
-
Compresses the given InputStream and returns an OutputStream.
- COMPRESSION - Static variable in class org.torproject.metrics.collector.persist.WebServerAccessLogPersistence
-
- computeDescriptorDigest(byte[], String, String) - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgeDescriptor
-
- computeInitialDelayMillis(long, long, long) - Static method in class org.torproject.metrics.collector.cron.Scheduler
-
- computeSha256Base64Digest(byte[], String, String) - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgeDescriptor
-
- CONF_FILE - Static variable in class org.torproject.metrics.collector.Main
-
- config - Variable in class org.torproject.metrics.collector.cron.CollecTorMain
-
- Configuration - Class in org.torproject.metrics.collector.conf
-
Initialize configuration with defaults from collector.properties,
unless a configuration properties file is available.
- Configuration() - Constructor for class org.torproject.metrics.collector.conf.Configuration
-
- ConfigurationException - Exception in org.torproject.metrics.collector.conf
-
- ConfigurationException() - Constructor for exception org.torproject.metrics.collector.conf.ConfigurationException
-
- ConfigurationException(String) - Constructor for exception org.torproject.metrics.collector.conf.ConfigurationException
-
- ConfigurationException(String, Exception) - Constructor for exception org.torproject.metrics.collector.conf.ConfigurationException
-
- ConsensusPersistence - Class in org.torproject.metrics.collector.persist
-
- ConsensusPersistence(RelayNetworkStatusConsensus, long) - Constructor for class org.torproject.metrics.collector.persist.ConsensusPersistence
-
Initialize with appropriate annotation and given parameters.
- create(Path) - Static method in class org.torproject.metrics.collector.webstats.LogMetadata
-
Only way to create a LogMetadata object from a given log path.
- createIndexerTask(Path) - Method in class org.torproject.metrics.collector.indexer.CreateIndexJson
-
Create an indexer task for indexing the given file.
- CreateIndexJson - Class in org.torproject.metrics.collector.indexer
-
Create an index file called index.json
containing metadata of all
files in the indexed/
directory and update the htdocs/
directory to contain all files to be served via the web server.
- CreateIndexJson(Configuration) - Constructor for class org.torproject.metrics.collector.indexer.CreateIndexJson
-
Initialize this class with the given configuration
.
- Criterium<T> - Interface in org.torproject.metrics.collector.sync
-
Interface for decisions to be made in the sync-process.
- sanitizeAndStoreExtraInfoDescriptor(byte[]) - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
Sanitizes an extra-info descriptor and writes it to disk.
- sanitizeAndStoreNetworkStatus(byte[], String, String) - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
Sanitizes a network status and writes it to disk.
- sanitizeAndStoreServerDescriptor(byte[]) - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
Sanitizes a bridge server descriptor and writes it to disk.
- SanitizedBridgeDescriptor - Class in org.torproject.metrics.collector.bridgedescs
-
- SanitizedBridgeExtraInfoDescriptor - Class in org.torproject.metrics.collector.bridgedescs
-
- SanitizedBridgeNetworkStatus - Class in org.torproject.metrics.collector.bridgedescs
-
- SanitizedBridgeServerDescriptor - Class in org.torproject.metrics.collector.bridgedescs
-
- SanitizedBridgesWriter - Class in org.torproject.metrics.collector.bridgedescs
-
Sanitizes bridge descriptors, i.e., removes all possibly sensitive
information from them, and writes them to a local directory structure.
- SanitizedBridgesWriter(Configuration) - Constructor for class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
Initialize configuration.
- sanitizedBytes - Variable in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgeDescriptor
-
- SanitizeWeblogs - Class in org.torproject.metrics.collector.webstats
-
This module processes web-logs for CollecTor according to the weblog
sanitation specification published on metrics.torproject.org.
- SanitizeWeblogs(Configuration) - Constructor for class org.torproject.metrics.collector.webstats.SanitizeWeblogs
-
Possibly privacy impacting data is replaced by dummy data producing a
log-file (or files) that confirm(s) to Apache's Combined Log Format.
- scheduleModuleRuns(Map<Key, Class<? extends CollecTorMain>>, Configuration) - Method in class org.torproject.metrics.collector.cron.Scheduler
-
Schedule all classes given according to the parameters in the configuration
and return whether the caller should wait for completion.
- Scheduler - Class in org.torproject.metrics.collector.cron
-
Scheduler that starts the modules configured in collector.properties.
- sensitivePartsSanitizer - Variable in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgeDescriptor
-
- SensitivePartsSanitizer - Class in org.torproject.metrics.collector.bridgedescs
-
- SEP - Static variable in class org.torproject.metrics.collector.persist.WebServerAccessLogPersistence
-
- SEP - Static variable in class org.torproject.metrics.collector.webstats.WebServerAccessLogImpl
-
Logfile name parts separator.
- SERVERDESC - Static variable in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
- ServerDescriptorPersistence - Class in org.torproject.metrics.collector.persist
-
- ServerDescriptorPersistence(RelayServerDescriptor, long) - Constructor for class org.torproject.metrics.collector.persist.ServerDescriptorPersistence
-
- SERVERDESCS - Static variable in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
- setArchiveReader(ArchiveReader) - Method in class org.torproject.metrics.collector.relaydescs.RelayDescriptorParser
-
- setIp(String) - Method in class org.torproject.metrics.collector.webstats.WebServerAccessLogLine
-
Only used internally during sanitization.
- setProperty(String, String) - Method in class org.torproject.metrics.collector.conf.Configuration
-
Sets the value for key.
- setRawDescriptorBytes(byte[]) - Method in class org.torproject.metrics.collector.webstats.WebServerAccessLogImpl
-
- setRelayDescriptorDownloader(RelayDescriptorDownloader) - Method in class org.torproject.metrics.collector.relaydescs.RelayDescriptorParser
-
- setRequest(String) - Method in class org.torproject.metrics.collector.webstats.WebServerAccessLogLine
-
Only used internally during sanitization.
- ShutdownHook - Class in org.torproject.metrics.collector.cron
-
Scheduler that starts the modules configured in collector.properties.
- ShutdownHook() - Constructor for class org.torproject.metrics.collector.cron.ShutdownHook
-
Names the shutdown thread for debugging purposes.
- shutdownScheduler() - Method in class org.torproject.metrics.collector.cron.Scheduler
-
Try to shutdown smoothly, i.e., wait for running tasks to terminate.
- size() - Method in class org.torproject.metrics.collector.conf.Configuration
-
Count of properties.
- SnowflakeStatsDownloader - Class in org.torproject.metrics.collector.snowflake
-
- SnowflakeStatsDownloader(Configuration) - Constructor for class org.torproject.metrics.collector.snowflake.SnowflakeStatsDownloader
-
Instantiate the snowflake-stats module using the given configuration.
- SnowflakeStatsPersistence - Class in org.torproject.metrics.collector.persist
-
- SnowflakeStatsPersistence(SnowflakeStats) - Constructor for class org.torproject.metrics.collector.persist.SnowflakeStatsPersistence
-
- SOURCES - Static variable in class org.torproject.metrics.collector.cron.CollecTorMain
-
- SourceType - Enum in org.torproject.metrics.collector.conf
-
- startProcessing() - Method in class org.torproject.metrics.collector.bridgedb.BridgedbMetricsProcessor
-
Start processing files, which includes reading BridgeDB statistics files
from disk, possibly decompressing them and splitting them by date, and
writing them back to disk.
- startProcessing() - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
- startProcessing() - Method in class org.torproject.metrics.collector.bridgepools.BridgePoolAssignmentsProcessor
-
Start processing files, which includes reading original, not-yet-sanitized
bridge pool assignment files from disk, splitting them into bridge pool
assignment descriptors, sanitizing contained fingerprints, and writing
sanitized bridge pool assignments to disk.
- startProcessing() - Method in class org.torproject.metrics.collector.bridgestrap.BridgestrapStatsDownloader
-
- startProcessing() - Method in class org.torproject.metrics.collector.cron.CollecTorMain
-
Module specific code goes here.
- startProcessing() - Method in class org.torproject.metrics.collector.exitlists.ExitListDownloader
-
- startProcessing() - Method in class org.torproject.metrics.collector.indexer.CreateIndexJson
-
Run the indexer by (1) adding new files from indexed/
to the index,
(2) adding old files from htdocs/
for which only links exist to the
index, (3) scheduling new tasks and updating links in htdocs/
to
reflect what's contained in the in-memory index, and (4) writing new
uncompressed and compressed index.json
files to disk.
- startProcessing(Instant) - Method in class org.torproject.metrics.collector.indexer.CreateIndexJson
-
- startProcessing() - Method in class org.torproject.metrics.collector.onionperf.OnionPerfDownloader
-
- startProcessing() - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
- startProcessing() - Method in class org.torproject.metrics.collector.snowflake.SnowflakeStatsDownloader
-
- startProcessing() - Method in class org.torproject.metrics.collector.webstats.SanitizeWeblogs
-
- stayAlive() - Method in class org.torproject.metrics.collector.cron.ShutdownHook
-
Stay alive until the shutdown thread gets run.
- storagePath - Variable in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
- storeAll(Path, Path) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor to all locations.
- storeAll(String, String) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor to all locations.
- storeAll(String, String, StandardOpenOption, StandardOpenOption) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor to all locations.
- storeAll(String, String) - Method in class org.torproject.metrics.collector.persist.WebServerAccessLogPersistence
-
Logs are not appended.
- storeCertificate(byte[], String, long) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a key certificate to disk.
- storeConsensus(byte[], long, SortedSet<String>, SortedSet<String>) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a consensus to disk and adds all referenced votes and server
descriptors to the list of missing descriptors.
- storeDesc(Descriptor, long) - Method in class org.torproject.metrics.collector.sync.SyncPersistence
-
Stores a descriptor in main storage and recent.
- storeDescs(Iterable<Descriptor>, long) - Method in class org.torproject.metrics.collector.sync.SyncPersistence
-
Stores descriptors in main storage and recent.
- storeExtraInfoDescriptor(byte[], String, long) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores an extra-info descriptor to disk.
- storeMicrodescConsensus(byte[], long, SortedSet<String>) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a microdesc consensus to disk and adds all referenced
microdescriptors to the list of missing descriptors.
- storeMicrodescriptor(byte[], String, long) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a microdescriptor to disk.
- storeMicrodescriptor(byte[], String, String, long) - Method in class org.torproject.metrics.collector.relaydescs.RelayDescriptorParser
-
Forwards the given microdescriptor to the archive writer to store
it to disk and tells the relay descriptor downloader that this
microdescriptor is not missing anymore.
- storeOut(String) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor in out (i.e.
- storeOut(String, StandardOpenOption) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor in out (i.e.
- storeOut(String, StandardOpenOption) - Method in class org.torproject.metrics.collector.persist.OnionPerfPersistence
-
If the original descriptor file was a .tpf file, append the parsed Torperf
result to the destination .tpf file, but if it was a .json.xz file, just
copy over the entire file, unless it already exists.
- storeRecent(String) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor in recent.
- storeRecent(String, StandardOpenOption) - Method in class org.torproject.metrics.collector.persist.DescriptorPersistence
-
Stores the descriptor in recent.
- storeRecent(String, StandardOpenOption) - Method in class org.torproject.metrics.collector.persist.OnionPerfPersistence
-
If the original descriptor file was a .tpf file, append the parsed Torperf
result to the destination .tpf file, but if it was a .json.xz file, just
copy over the entire file, unless it already exists.
- storeRecent(String) - Method in class org.torproject.metrics.collector.persist.WebServerAccessLogPersistence
-
Logs are not appended.
- storeServerDescriptor(byte[], String, long, String) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a server descriptor to disk and adds the referenced
extra-info descriptor to the list of missing descriptors.
- storeToFileSystem(byte[], byte[], Path, StandardOpenOption) - Static method in class org.torproject.metrics.collector.persist.PersistenceUtils
-
Stores a descriptor adding missing annotations with the given options.
- storeToFileSystem(byte[], byte[], Path, StandardOpenOption, boolean) - Static method in class org.torproject.metrics.collector.persist.PersistenceUtils
-
Stores a descriptor adding missing annotations with the given options.
- storeVote(byte[], long, String, String, SortedSet<String>) - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
Stores a vote to disk and adds all referenced server descriptors to
the list of missing descriptors.
- SyncManager - Class in org.torproject.metrics.collector.sync
-
- SyncManager() - Constructor for class org.torproject.metrics.collector.sync.SyncManager
-
- syncMapPathsDescriptors() - Method in class org.torproject.metrics.collector.cron.CollecTorMain
-
Returns map of path and descriptor type for download.
- syncMarker() - Method in class org.torproject.metrics.collector.bridgedb.BridgedbMetricsProcessor
-
Return the synchronization marker.
- syncMarker() - Method in class org.torproject.metrics.collector.bridgedescs.SanitizedBridgesWriter
-
- syncMarker() - Method in class org.torproject.metrics.collector.bridgepools.BridgePoolAssignmentsProcessor
-
Return the synchronization marker.
- syncMarker() - Method in class org.torproject.metrics.collector.bridgestrap.BridgestrapStatsDownloader
-
- syncMarker() - Method in class org.torproject.metrics.collector.cron.CollecTorMain
-
Returns property prefix/infix/postfix for Sync related properties.
- syncMarker() - Method in class org.torproject.metrics.collector.exitlists.ExitListDownloader
-
- syncMarker() - Method in class org.torproject.metrics.collector.indexer.CreateIndexJson
-
- syncMarker() - Method in class org.torproject.metrics.collector.onionperf.OnionPerfDownloader
-
- syncMarker() - Method in class org.torproject.metrics.collector.relaydescs.ArchiveWriter
-
- syncMarker() - Method in class org.torproject.metrics.collector.snowflake.SnowflakeStatsDownloader
-
- syncMarker() - Method in class org.torproject.metrics.collector.webstats.SanitizeWeblogs
-
- SYNCORIGINS - Static variable in class org.torproject.metrics.collector.sync.SyncManager
-
- SyncPersistence - Class in org.torproject.metrics.collector.sync
-
Provides persistence for descriptors based on the descriptor type.
- SyncPersistence(Configuration) - Constructor for class org.torproject.metrics.collector.sync.SyncPersistence
-
Initialize with the given configuration.