Context returns the context the job is being run in. It should (usually) be the parent context of all others in the job.

FullPath returns the full file system path for a data file, including the repo path. It converts forward slashes in the input to the file system path

authFunc gets the authentication function for this service. If s.Authenticate is set, it returns that; if s.OAuth2 is set, it uses a standard OAuth2 f

StringData makes it easy to return a simple string as an item's data.

Logger returns a logger for the job.

Contains returns true if the given time ts is inside the timeframe tf. Only tf.Since and tf.Until are used; tf.SinceItemID and tf.UntilItemID are igno

FileExists returns true if the named file exists in the DirEntry's FS starting from the DirEntry's filename.

getOpenTimeline gets an open timeline designated by instance ID. If the timeline is not open, a structured error is returned.

ToItem links an item to the node on this graph such that the edge goes from the graph node to the item.

ToEntity links an entity to the node on this graph such that the edge goes from the graph node to the entity.

FixString fixes a malformed string created by decoding UTF-8-encoded JSON string values as UTF-16 strings. JSON string values *should* be encoded as U

Anonymize obfuscates the entity.

Stat stats the named file from the DirEntry's FS rooted at the DirEntry's Filename.

EXAMPLE: "geo:30.123456,-105.987654"

Clean removes keys with empty values (including numeric 0 and non-empty strings and byte slices containing only spaces) or keys that are the empty str

Run runs or resumes a job. It should utilize the checkpoint, if set, to resume an interrupted job. CPU-intensive work should use the throttle. If poss

FileExistsFS returns true if name exists in fsys.

ID returns the database row ID of the job.

With is a promotion of the embedded Core.With() method so that we can ensure derivative loggers are our type, not the embedded type, to preserve our o

Close frees up resources allocated from Open.

ExtractAllMetadata reads the file at the given path in the given file system and tries to extract any and all metadata it can find. The metadata will

IsEmpty returns true if there is no x, y, or z coordinate.

Implement sort.Interface

Location converts the coordinates into a item-processable Location value.

Open opens the named file from the DirEntry's FS rooted at the DirEntry's Filename.

latLonBounds returns low and high bounds for an acceptable lat/lon value, as well as the decimal precision used, which can be useful in SQL queries fo

deleteRepoFile deletes the file at pathInRepo, which is a path relative to the repo root, or a path within the repo root (if the given path is prefixe

nullableUnixMilli returns the Unix epoch millisecond UTC timestamp associated with the given time value. If it is nil or zero, nil is returned. Otherw

AttributeValue gets the value of the (first-)named attribute from the entity.

ContainsItem returns true if the timeframe contains the item, according to its timestamp and timespan (start and end) values, with respect to strict m

FileExists returns true if file exists.

NextLocation returns the next location to process. When there are no more locations, it should return (nil, nil). Implementations must honor context

ReadDir reads the direcftory at the named path from the DirEntry's FS rooted at the DirEntry's Filename.

TODO: all of these methods should be cancelable by the browser... somehow

Size returns the number of nodes in the graph

flushProgress writes a log that the UI uses to update the progress of the job if it has been enough time since the last flush (we don't need to update

ByteData makes it easy to return a simple byte array as an item's data.

Merge adds the incoming metadata to m according to the specified conflict policy.

NewLocationProcessor returns a new location source that filters, refines, clusters, and possibly simplifies the locations it reads from source. The r

findFileID looks up the file ID in the manifest for the file given by its domain and path relative to that domain.

TODO: do we really need to use the default 32-byte digest? What if 16 bytes or even 8 is enough for us?

TODO: Very WIP / experimental

FileImport conducts an import of the data using this data source.

ToItemWithValue connects g to item with a relation that has the given value.

httpWrap wraps a standard http.Handler with a handlerFunc signature.

stripPrefaces reads from f until a '=' is encountered. (Each .js file starts with a variable definition at the beginning.)

text returns the full text of the tweet, with entities added inline.