Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix processing speed in eventhubs-streamanalytics-cosmosdb #40

Open
algattik opened this issue Jul 8, 2019 · 0 comments
Open

Fix processing speed in eventhubs-streamanalytics-cosmosdb #40

algattik opened this issue Jul 8, 2019 · 0 comments
Assignees
Labels

Comments

@algattik
Copy link
Collaborator

algattik commented Jul 8, 2019

OutgoingMessages should keep up with IncomingMessages (600k per minute)

cd eventhubs-streamanalytics-cosmosdb
./create-solution.sh -d myrg -t 10 -l northeurope
[...]
starting to monitor locusts for 20 seconds... 
locust is sending 872 messages/sec
locust is sending 1621 messages/sec
locust is sending 2697.375 messages/sec
locust is sending 3455.9 messages/sec
locust is sending 5471.5 messages/sec
locust is sending 6810.2 messages/sec
locust is sending 7971.5 messages/sec
locust is sending 9053 messages/sec
locust is sending 9561.8 messages/sec
locust is sending 9753.8 messages/sec
monitoring done
locust monitor available at: http://52.155.179.29:8089

***** [M] Starting METRICS reporting
Event Hub capacity: 12 throughput units (this determines MAX VALUE below).
Reporting aggregate metrics per minute, offset by 1 minute, for 30 minutes.
                                IncomingMessages       IncomingBytes    OutgoingMessages       OutgoingBytes   ThrottledRequests
                                ----------------       -------------    ----------------       -------------  ------------------
                   MAX VALUE              720000           720000000             2949120          1440000000                   -
                                ----------------       -------------    ----------------       -------------  ------------------
    2019-07-08T08:41:51+0200                   0                   0                   0                   0                   0
    2019-07-08T08:42:00+0200                   0                   0                   0                   0                   0
    2019-07-08T08:43:00+0200               53900            53219651               49959            49327981                   0
    2019-07-08T08:44:00+0200              515056           508587368              496420           490177954                   0
    2019-07-08T08:45:00+0200              598890           591349724              578479           571203437                   0
    2019-07-08T08:46:00+0200              600572           593017681              561561           554499015                   0
    2019-07-08T08:47:00+0200              597500           589985683              563482           556393599                   0
    2019-07-08T08:48:00+0200              600960           593408050              513331           506880384                   0
    2019-07-08T08:49:00+0200              601521           593959016              593205           585749886                   0
    2019-07-08T08:50:00+0200              601282           593717804              500150           493861481                   0
    2019-07-08T08:51:00+0200              604751           597149192              514832           508366889                   0
    2019-07-08T08:52:00+0200              608397           600748827              472418           466475537                   0
    2019-07-08T08:53:00+0200              606160           598535776              474963           468996517                   0
    2019-07-08T08:54:00+0200              607886           600239871              477438           471441458                   0
    2019-07-08T08:55:00+0200              605485           597875502              471086           465163684                   0
    2019-07-08T08:56:00+0200              608527           600871623              524951           518354312                   0
    2019-07-08T08:57:00+0200              607039           599406517              399120           394100780                   0
    2019-07-08T08:58:00+0200              607360           599739819              471705           465777118                   0
    2019-07-08T08:59:00+0200              607220           599573247              450127           444471194                   0
    2019-07-08T09:00:00+0200              609149           601490846              452120           446435778                   0
    2019-07-08T09:01:00+0200              609889           602221035              480420           474384460                   0
    2019-07-08T09:02:00+0200              608722           601070463              416933           411690081                   0
    2019-07-08T09:03:00+0200              603686           596098118              473337           467389152                   0
    2019-07-08T09:04:00+0200              590519           583094755              444143           438559398                   0
    2019-07-08T09:05:00+0200              600124           592579242              426720           421356704                   0
    2019-07-08T09:06:00+0200              606179           598555994              461778           455984029                   0
    2019-07-08T09:07:00+0200              601860           594294746              428422           423034922                   0
    2019-07-08T09:08:00+0200              603490           595902290              474911           468950668                   0
    2019-07-08T09:09:00+0200              602521           594955778              481977           475913196                   0
    2019-07-08T09:10:00+0200              604696           597083899              385932           381093727                   0

***** Done
@algattik algattik added the bug label Jul 8, 2019
@algattik algattik self-assigned this Jul 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant