Twitter - Revision history

CG: Text replacement - "syntaxhighlight" to "pre"

2023-12-01T16:38:34Z

Text replacement - "syntaxhighlight" to "pre"

CG: Text replacement - "" to ""

2023-12-01T16:32:14Z

Text replacement - "</syntaxhighlight>" to "</pre>"

CG: Text replacement - "
" to "
"

2023-03-09T08:17:31Z

Text replacement - "<br />" to "<br/>"

CG: /* BaseX as Twitter Storage */

2020-07-02T11:18:46Z

BaseX as Twitter Storage

CG at 11:17, 2 July 2020

2020-07-02T11:17:52Z

CG: Text replacement - "[http://www.json.org" to "[https://www.json.org"

2020-07-02T10:42:07Z

Text replacement - "[http://www.json.org" to "[https://www.json.org"

CG at 13:55, 27 February 2020

2020-02-27T13:55:36Z

Show changes

CG at 13:21, 27 February 2020

2020-02-27T13:21:38Z

CG at 14:59, 10 April 2019

2019-04-10T14:59:02Z

CG: Text replace - "\[\[Category:Internals\]\]" to ""

2016-01-17T13:59:15Z

Text replace - "\[\[Category:Internals\]\]" to ""

@@ Line 93: / Line 93: @@
 ==Example Tweet (JSON)==
-<syntaxhighlight lang="json">
+<pre lang="json">
+{
    "contributors": null,
@@ Line 168: / Line 168: @@
 ==Example Tweet (XML)==
-<syntaxhighlight lang="xml">
+<pre lang="xml">
 <json booleans="retweeted possibly__sensitive truncated favorited possibly__sensitive__editable default__profile profile__background__tile protected contributors__enabled verified default__profile__image geo__enabled profile__use__background__image show__all__inline__media is__translator"
    numbers="id retweet__count statuses__count favourites__count followers__count friends__count listed__count"

@@ Line 164: / Line 164: @@
    "coordinates": null
+}
-</syntaxhighlight>
+</pre>
 ==Example Tweet (XML)==
@@ Line 240: / Line 240: @@
    <coordinates/>
 </json>
-</syntaxhighlight>
+</pre>
 = BaseX Performance =

@@ Line 245: / Line 245: @@
 The test show the time BaseX needs to insert large amounts of real tweets into a database. We can derive that BaseX scales very well and can keep up
-with the incoming amount of tweets in the stream. Some lower values can occur, cause the size of the tweets differ according to the meta-data contained in the tweet object.<br />
+with the incoming amount of tweets in the stream. Some lower values can occur, cause the size of the tweets differ according to the meta-data contained in the tweet object.<br/>
 Note: The {{Option|AUTOFLUSH}} option is set to <code>FALSE</code>.

@@ Line 6: / Line 6: @@
 = BaseX as Twitter Storage=
-For retrieving the Twitter stream we connect with the Streaming API to the endpoint of Twitter and receive a never ending tweet stream. As Twitter delivers the tweets as [https://www.json.org/ JSON] objects the objects has to be
+For retrieving the Twitter stream we connect with the Streaming API to the endpoint of Twitter and receive a never-ending tweet stream. As Twitter delivers the tweets as [https://www.json.org/ JSON] objects, the data is converted into XML fragments. For this purpose, the parse function of the [[JSON Module|XQuery JSON Module]] is used. In the examples section both versions are shown ([[#Example Tweet (JSON)|tweet as JSON]] and [[#Example Tweet (XML)|tweet as XML]]). For storing the tweets including the meta-data, we use the standard ''insert'' function of [[Updates|XQuery Update]].
 =Twitter’s Streaming Data=

@@ Line 1: / Line 1: @@
 This article is part of the [[Advanced User's Guide]]. It is about the usage of BaseX for processing and storing the live data stream of Twitter. We illustrate some statistics about the Twitter data and the performance of BaseX.
-As [http://twitter.com Twitter] attracts more and more users (over 140 million active users in 2012) and is generating large amounts of data (over 340 millions of short messages ('tweets') daily), it became a really exciting data source for
+As Twitter attracts more and more users (over 140 million active users in 2012) and is generating large amounts of data (over 340 millions of short messages ('tweets') daily), it became a really exciting data source for
-all kind of analytics. Twitter provides the developer community with a set of [https://dev.twitter.com/start APIs] for retrieving the data about its users and their communication, including the [https://dev.twitter.com/docs/streaming-apis Streaming API] for data-intensive applications, the [https://dev.twitter.com/docs/using-search Search API] for querying and filtering the messaging content, and the [https://dev.twitter.com/docs/api REST API] for accessing the core primitives of the Twitter platform.
+all kind of analytics. Twitter provides the developer community with a set of [https://developer.twitter.com/start APIs] for retrieving the data about its users and their communication, including the Streaming API for data-intensive applications, the [https://dev.twitter.com/docs/using-search Search API] for querying and filtering the messaging content, and the [https://dev.twitter.com/docs/api REST API] for accessing the core primitives of the Twitter platform.
 = BaseX as Twitter Storage=

← Older revision		Revision as of 13:59, 17 January 2016
Line 286:		Line 286:

	[[File:insertTweets.png]]		[[File:insertTweets.png]]
−
−	~~[[Category:Internals]]~~