[ 3 / biz / cgl / ck / diy / fa / ic / jp / lit / sci / vr / vt ] [ index / top / reports ] [ become a patron ] [ status ]
2023-11: Warosu is now out of extended maintenance.

/biz/ - Business & Finance


View post   

File: 153 KB, 454x261, Algo-Trading.png [View same] [iqdb] [saucenao] [google]
1338027 No.1338027 [Reply] [Original]

Anyone build algorithmic trading models? I've been playing around with it for about 6 months now -- just learning the basics and enjoying the challenge.

I've been writing mostly in Python (Quantopian) but do know R fairly well.

Any suggestions on books/forums/general strategies that you might recommend?

As I have been mostly focused on stocks, I'd like to know if anyone has built a model to trade cryptocurrencies? Anyone had any luck?

Appreciate any help/advice you can offer to a newbie!

>> No.1338029

Protip: computerized guessing is still guessing. You're gonna lose.

>> No.1338037

>>1338029

True. I wouldn't ever risk anything that I couldn't afford to lose. Also would never go live without years of good backtesting + forward paper trading for 1+ year.

Mostly I enjoy the intellectual challenge that it presents.

>> No.1338069

Hey OP. I'm interested in this as well. I'm actively researching quantitative analysis in order to build a crypto trading bot. I haven't done enough research to be of any help to you but I have some books I've downloaded, though you may have heard about them already.

>> No.1338078

>>1338027
Just got done with internship at firm that was doing neural network trading. I definitely want to get into that field, it was dope.

>> No.1338101

>>1338069

Nice! The last few books I've read: a couple of Ernie Chan's books (quantitative trading/algorithmic trading), David Aronson (evidence based technical analysis), and a couple python for finance (o'reilly books). Not sure the popular opinion on those, but they seemed fine.

>>1338078
Definitely interested in a NN model, but I'm hesitant to dive into black-box methodologies. Did you get access to some of the inputs/variables they were using?

>> No.1338536

Even I'm interested in this. There was an anon a few months ago who pointed me in the right direction with some book recs. Trying to ping that anon if he's here
I'm super interested in this as well. Bump for discussion

>> No.1338546

>>1338029
Not if someone could figure out how to make a computer buy low and sell high. I don't know if it's possible though

>> No.1338984
File: 488 KB, 600x450, guacaveli.png [View same] [iqdb] [saucenao] [google]
1338984

>>1338536
i am here.

>> No.1338993

>>1338027
I have a python trading bot for poloniex. I stopped developing it as i had no idea about trading models. If you post a throwaway email i can give it to you. Maybe you can pump it up to be more successful.

>> No.1338997

>>1338993
ProTip: I cooked about 60 trading strategies before I found one that kicked ass. I've made over 200 now, and I have gotten about 6 great strategies out of it.

Persistence, my friend.

>> No.1339052
File: 66 KB, 327x234, matlablogo.jpg [View same] [iqdb] [saucenao] [google]
1339052

What does /ATG/ think of MATLAB?

I wrote some simple programs for modelling options in it, and I like it way better than Python or Java.

Also is Haskell any good?

>> No.1339074

>>1339052
I used Java, I've never played with MatLab.

I hear it's pretty great, but I also hear it depends on community-created plugins to integrate into Interactive Brokers. Is that true?

>> No.1339079

>>1339052
care to share some matlab scripts ?
I' currently writing my dissertation on an empirical comparison of option pricing models. You could really help me cross check some scripts I've already written myself.

>> No.1339091

>>1339052
>>1339079

I just use Matlab for electronical calculations, but this sounds interresting.
Care to share?

>> No.1339093

>>1338984
I don't believe you. For starters recommend those books to me I have a screenshot of them

>> No.1339111

>>1339093
> Robert Pardo's Evaluation and Optimization of Trading Strategies.

That's my go-to recommendation. If I suggested something else, it was probably that Mr Swing white paper on regime-switching or a few selections from my library on general HFT theory. Like, "All About High Frequency Trading" by Durbin.

Sound about right?

>> No.1339133

Bumped for righteous glory

>> No.1339140
File: 49 KB, 550x350, guac_is_in_the_house.jpg [View same] [iqdb] [saucenao] [google]
1339140

>>1338984
>>1339093

>> No.1339146

>>1339079
>>1339091
Nothing special dudes, I've used MATLAB for lots of university projects solving differential equations and I had some spare time.

I implemented the Black Scholes model in it, which also calculates the volatility from a Yahoo Finance spreadsheet, and churns out 2 approximations for option pricing (based on different methods of calculating volatility) and a simpel stochastic differential equation solver, like in this link (in the link it's in Python):

https://en.wikipedia.org/wiki/Euler%E2%80%93Maruyama_method

I'm planning to expand on this during summer break so I can make a simple script for hedging options or other derivatives.

>> No.1339156

>>1339146
Also MATLAB has a special "Finance Toolbox" that already has all those things, but my university license doesn't cover that. Implementing those things yourself is more fun anyway.

>> No.1339178

>>1339111
Wow you're right about pardo. You recommended two more actually. You were also highly evasive about your income but rightly so since you said that it allows you to live comfortably.
What's your background? I'm gonna do engineering and will read those books in between studying.

>> No.1339181

got a system that i manually trade. in fact i live trade it and am profitable. need to code a bot because the setups are so specific i would be sitting at the computer for sometimes days without entries.

my 2 cents:
if you approach the problem from a traditional quant perspective, you will likely fail. remember the big boys have teams of people with likely far higher IQs than you and with greater experience trading than you. they also have market data going back as far as it goes with every major global market.

if i told a quant guy my strat, he'd would at first laugh. but he's a scientist so he'd backtest it for giggles. then he'd cry because something so simple shouldn't work.

if i told a traditional buy/hold investor, they would straight out tell me it would NEVER work.

good luck, to everybody. fwiw, i have 3 strats that work completely different and in different timeframes. they are capable of long and short entries.

>> No.1339188

>>1338993

That'd be awesome! Thanks man. Would love to check out your work.

ccbq13@yahoo.com is an old throwaway.

>> No.1339197

>>1339188

Thanks for the inspiration.... and totally agree - non-conventional approaches are my focus.. i.e., taking solutions to problems found in other domains and applying them to predicting stocks..


>>1339111
Thanks for the recommendation. I willl read that book next.

>> No.1339201

>>1339181
Read that Pardo book. It'll elevate your game.

The dirty secret of all the big boys is that their "magic" is just as simple and straightforward as yours. "Quant" is all smoke and mirrors IMHO.

I've never seen anything to make me believe there's one all powerful strategy that works in every regime. It's all just simple tricks and nonsense.


>>1339178
Biotech in college.
Programming everyday since boyhood.

Read everything. Study every trading/portfolio system you can find. Try everything and see what sticks. See above.

>> No.1339212
File: 17 KB, 909x461, algo recs.png [View same] [iqdb] [saucenao] [google]
1339212

>>1339201
pretty sure i've conversed with you before. i only recently became confident enough with my win% to look into properly coding a bot. my biggest challenged is establishing an exit when trades move against me.

got a folder of algo books you recommended from the last time.

if someone is looking for some human inspiration: market wizards series by jack schwager. the one thing all these guys had in common was pure obsession.

>> No.1339224

>>1338997
What kind of trading strategies?
Mostly TA?

>> No.1339243

>>1339212

You can work backwards. Study the distribution of your trades' high&lows. It'll hint at a good initial stop-loss. Then you can cross-optimize with some trailing stop logic if it's long term positions (>20 seconds). Read that Pardo book.

>>1339224
Fun Fact:
Before The Great Depression there was this famous trader named Gann. He made a fortune trading according to his interpretation of the Zodiac.

I much prefer clearly defined math and repeatable results.

>> No.1339249

>>1339243
>>1339201
Before I begin reading I wanna ask will I understand it? Do I need a special background in anything?
Btw what are your thoughts on Quintilian?

>> No.1339251

>>1339243
So I'm guessing no TA then?

I was planning on writing a TA bot for poloniex. I am not a firm supporter of TA but I do believe that especially with Crypto it is a self-fulfilling prophecy.

Nonetheless, thanks for the books I am going to read all of them. Just finished CFA 1 so this is going to be a good addition to my overal financial/trading knowledge.

>> No.1339260

>>1339243
i'm far better determining market direction now. i had trade a week ago move against me by 30 ticks and i looked at the data, i was right. so i held for another 5 mins. it swung my way and completely surpassed my profit exit for the rest of the day. most of my trades are longer than 1 minute. me and you operate in different timeframes. i'm not at your level :(.

still early going yet. i want another year of minute data in my records before coding anything. i don't know a fucking thing about coding. baby steps first. acquire data, forward test via live trading, then coding. shit is going to get crazy when i start trading correlated instruments.

>> No.1339334

>>1339188
sent

>> No.1339338

>>1339260
You can get that data from eoddata.com for like $10

>> No.1339340

>not a single mention of market impact
you are all small time and liars who read too much internet

>> No.1339355

>>1339338
forward, real time data. even end of minute data is not quite accurate as i've submitted orders and had the bar move quite a few ticks against me. my confidence level will be very high if i can continue to live trade over the next year profitably. even with supplied data, i'd still have to code something to backtest my strat. and as i said, i know fuck all.

>>1339340
nobody here claimed to be big time. ES trade over 4 million contracts on brexit. i traded less than 100. my impact is fuck all. which is exactly how i like it.

>> No.1339357

>>1339334
>>1338993
Could you send me that too?
32573@svk.jp

>> No.1339363

I'm new to coding and still learning basics and syntax with Python. Is there any good material for me to move onto about algo's after I gain some experience?

>> No.1339375

A lot of "quant trading" is doing things like reading an SEC filing before anyone can get. Or inputting an order before everyone else.

There are basic things which always happens. CEO gets caught fucking a little girl in the office? Stock prices will drop, you're goal as a quant trader is to put in the order first before traditional traders even hear the news.

There are millions of things like this, some of them not so obvious. Random variables x, y, and z go up and a and b go down means the stock price is about to jump up with 95% confidence 500 basis points.

I've been a hobbyist in quant trading for like 2 years now and I'm interning at KCG as a quant trader at the moment and this is the kind of internal shit they have.

In fact the CEO thing is what my manager said to me second day

>> No.1339431

>>1339340
Said the tripcode.

>> No.1339457

>>1338101
>Did you get access to some of the inputs/variables they were using?
i only used the most basic stuff cause i had absolutely no idea what i was doing since i am 18. i was very intrigued by whole concept of the computers doing all the trading. i am not sure if the traders were using mostly learning technique or something else.

how do i into this field?

>> No.1339509
File: 61 KB, 800x533, strategy development cycles.png [View same] [iqdb] [saucenao] [google]
1339509

>>1339457
You need to be a programmer first.
Then you read a general book on HFT theory.
Pick a Broker with an API.
Build a trading engine.
Cook up some strategies.
Push the button that says "Start Making Money" and hope you didn't miss something.

>> No.1339551
File: 118 KB, 640x960, IMG_3550.png [View same] [iqdb] [saucenao] [google]
1339551

>>1339509
I read the physics envy one and it was too tough for me. Didn't get the theorems and such

>> No.1339566

>>1339509

You seem to know your shit. I've some questions for you:

1º In the long term, would this type of trading be worth it compared to say investing in regular index funds?

2º What are some good forums/communities for this type of trading?

3º I've got programming chops and know how in machine learning and signal processing. How long would it take me to read up on HFT theory and start developing some strats?

>> No.1339568

>>1338037

tell that to jimmy simons

>> No.1339573

>>1339052


matlab is the best modeling software in the business. if you don't know matlab you're fucking yourself

>> No.1339693
File: 1.24 MB, 500x200, ultron.gif [View same] [iqdb] [saucenao] [google]
1339693

>>1339566

> 1º
A good algo trader can do in a day what a good index fund does in a good year. Take that with a grain, because it doesn't scale-up in terms of % like index funds do. However, in terms of Input Capital v Output Profit, Algo blows everything else away by miles.

>2º
I wish I knew. Why do you think I'm here?
I keep my eyes on the related reddits but they're mostly abandoned. This is a solo mission.

>3º
How long does it take to learn Chess?
The programming isn't hard at all.

The hard part is strategy and that just takes a fuckload of trial & error. Feeling around in the dark, collecting maths, making educated guesses, backtesting everything you can think of until something sticks.

There are only a handful of off-the-shelf algo trading platforms out there to build strats on. Each has its own drastic limitations and most cost a fortune.

IMHO the only way to do this right is to build your own tools from scratch and obviously that takes some time.

When I first got into this I got a lot of smirky comments.
> "if it was so easy, everyone would do it" .

I'm here to tell'yah it ain't that easy, but it's worth it.
pic related.

>> No.1339754

>>1339693

Thanks mate, I'll look up further on it then!

I owe you a beer.

>> No.1339769

>>1339052
well used among the machine learning community, quite a few funds use it for research

you could actually use it to build your own algos too - there is connectivity developed for CQG for example, and algo trading toolkit, libraries for signal processing

no good for a proper HFT system but for a hobby/part time algo trading project it is a pretty decent option and the existing libraries can save you a fair bit of time

>> No.1339775

>>1339375
What are some good sources for this early info?

>> No.1339948

>>1339754
>I owe you a beer.

What a stupid fucking thing to say on an anonymous online forum, cocksucker.

>> No.1339968
File: 34 KB, 400x300, 293353[1].jpg [View same] [iqdb] [saucenao] [google]
1339968

>>1339948
>"he calls people cocksuckers on internet forums!"

>> No.1340060

>>1339509
ooh thanks, i was gonna do Finance major with CS minor,

but i might switch it around next year i guess

>> No.1340395

>>1339693

Just curious but how many of you that are doing this successfully are currently scraping for news data to enhance your trading capabilities?
Like Brexit for example

>> No.1340556

>>1338029
half the time

>> No.1340682

>>1340395
NLP is hard
Quantifying mood from say Twitter feeds is possible but also not very reliable. Regardless, while it's semi-useful to detect when there are rumors of X or Y at company Z with straightforward consequences (merger, bankruptcy etc.), and even then you'd be wide open to market manipulation (or I guess you can trust the SEC to actually find people who spread rumors to cash out, as if lol), large events like brexit I'm not sure how you'd get a machine to make sense of the news considering even human experts struggle to make sense of it.
Depending on your algorithm this may or may not be relevant anyway. If your typical strat timescale is in seconds, you're going to care more about market microstructure than whatever macro-scale news event is unfolding. Micro-scale strats can also be pretty safe: when the portfolio takes a -40% hit in 15 minutes you had long exited the market.

>> No.1340726

>>1339573
How would I use MATLAB for trading though?

>> No.1340856

>>1340556
>half the time

>what are transaction fees and capital carry expenses?

100% of the time.

>> No.1340858

>>1338993
yeah man please
casvaldeikun14@gmail.com

>> No.1340918

>>1339178
Which other two books did he recommend?

If anyone cares, I found a PDF of the Pardo book here: http://traders-software.com/Trading%20Books/Robert%20Pardo%20-%20The%20Evaluation%20and%20Optimization%20of%20Trading%20Strategies/

>> No.1340934

>>1338993
Trying to get into this, i'd be very thankful.
1011010110u@gmail.com

>> No.1341068

>>1340918
See >>1339551

>> No.1341145

>>1339551
>>1341068

Thanks, मेरे बेनामी दोस्त! खूब तरक़्क़ी कर!

>> No.1341159

>>1338993
traclabisl@thraml.com
thanks man

>> No.1341187

>>1341145
Are va ek aur desi. Shukriya

>> No.1341250

>>gelin92@outlook.com -a throwaway I'm interested Op. Thanks

>> No.1341291

>>1338993
me too:
HDR22@clintonemail.com

>> No.1341378

>>1338993
Would greatly appreciate it
megferza@gmail.com

>> No.1342055

>>1338029
>I have absolutely no idea of how trading works

>> No.1342058

>>1339509

What brokers with an API are available in Europe?

>> No.1342072

>>1338993
Noobacca_@Hotmail.com

Plzzzz

>> No.1343410

>>1338027
what degree would be best to be taken up by an algo trading firm or department of a bank?

Assuming that the individual knows the essential languages.

I would suspect it would be some kind of quantitative one like the engineerings, actuarial, CS and then 2nd tier as finance, econ .

>> No.1343847

>>1343410
More about skill then degree, in Australia at least.
I know an arts student who works in a trade desk. Did lots of hobby work

>> No.1344188

>>1338993

Hopefully you're still here dude. If anyone else could forward it to me I'd appreciate that a lot.

Wondertoad123@gmail.com

>> No.1344677

>>1344188
I want to see it as well,

reet41@live.nl

Thanks /biz/raelis.

>> No.1345638

>>1343847
could you please tell me what kind of hobbies he did?

I've traded before with a little success, but, they were all a few month longs.

What other hobbies

>> No.1345678

>>1338993
>>1338993
Sorry to jump on the train, but I would appreciate the bot as well. I've been looking at trading models recently and this would help give me a head start. appreciate it.
fakemailwitz@gmail.com

>> No.1346087
File: 11 KB, 205x246, Unknown.jpg [View same] [iqdb] [saucenao] [google]
1346087

Anyone heard of bitbot? What's the best algorithm to use? I'm installing it now...

https://github.com/5an1ty/BitBot/blob/master/README.md

>> No.1346099

Why hasn't no one mentioned that you can use quantopian to trade live stock using robinhood aka no commission?

>> No.1346172

>>1338993
xnemesisx@live.nl

Much appreciated anon!

>> No.1346208

Glad there's some interest in this. Maybe we could always keep a general going with some basic intro?

Anyways, I've been working with machine learning and sports betting. After I get that nailed down more I plan to go after trading. Getting data and building all your own shit definitely take a lot of time but it'll pay off in the end.

>> No.1346259

Some fucks who post in RGT threads developed a 98% accurate trading algo over the course of three years. They call it "the spacedad algorithm" they've proved it's accuracy multiple times and instead of giving it out they just gave the website http://spacedad.me and told us to figure it out on our own. Apparently only a handful of people have figured it out. I am not smart enough however.

>> No.1346278

>>1338027
I've been playing with Heuristic search algorithms, trying to figure out how to pull data from the Cryptocoin market I use to set up alerts on my phone to big changes in price. honestly just tired of having to check that shit manually every 5 minutes.

>> No.1346322

>>1339052

I work in engineering, use it everyday, terrific software

>> No.1346365

>>1338993
ldlj43@gmail.com

I would like to get into it. Thank you for sharing your stuff :)

>> No.1347967

>>1346259
What's RGT?

>> No.1347985

>>1338993
>>1339188
>>1339357
>>1340858
>>1340934
>>1341159

Could any of you pass this along?
doogjy3@yahoo.com

>> No.1348475

>>1339775
Late as fuck response, but it's all over. Sentiment analysis on SEC filings, scanning financial reports.

The key is to do this automatically. The firm I work at, because noone can find me here, is Citadel, I'm an intern there right now.

There's a lot of focus on deploying HFT strategies (most of our strategies) in black boxes right next to the exchanges. This why our order gets on the fiber line straight to wallstreet as fast as possible.

Some of our strategies simply rely on picking off bad trades. Some retail guy selling at 4 cents below current ask? Buy all as long as downward momentum is over such and such limit. You see all the extra tiny "vibration" on certain stocks like microsoft? That's us or another big firm (Citadel is far from the biggest) just edging based on momentum models that act on the milisecond level.

Algo trading isn't hard, go on quantopian and download the hundreds of algos people host on there and play around.

If you want to do it professionally it's a different ball game. If you're not from an ivy or getting stats, CS, or math degree from a top school you're wasting your time.

If you are the above I highly recommend this field. Citadel, Bridgewater, KCG, Jump, or Tower Research pay a fucking shitton.

To give you an idea, as an intern I get paid 10k a month plus a housing stipend. Fucking delicious.

As a entry level quant researcher you can expected 110k-140k plus 150%-200% bonus on salary.

Quant traders basically the same base pay with 250%-400% bonus on salary.

Other firms pay a little less, but I know we've lost talent to a few other firms like Tower and a local company called 3Red here in Chicago. Although this is likely because the culture here is fucking cancer and it kills you inside every day

>> No.1348493

>>1338027
https://drive.google.com/folderview?id=0B1iikX5PwNx4d2dKQ3FTSWVRSDA&usp=sharing

>> No.1349429

>>1338993
>>1346172
>>1347985
>>1341159
>>1340934

Me as well please.

witchinghazel@gmail.com

>> No.1349464

>>1338993
mind if you post it on lain chans volafile room?
volafile io/r/ kUFzLJ

>> No.1349530

>>1338993
>>>1338993
>>>1346172
>>>1347985
>>>1341159
>>>1340934

Thank you my dear anon!
dpfkgsa@gmail.com

>> No.1349746

>>1340934
>>1341159
>>1347985
>>1346172
>>1338993
>>1338993
>>1349530

Anyone manage to get their hands on this?

>> No.1349792
File: 6 KB, 505x78, 4Xg7w7H.png [View same] [iqdb] [saucenao] [google]
1349792

>>1338029

Then i "GUESS" il'l just never have to work again.

Ba dum Tshh...

>> No.1349801
File: 149 KB, 396x385, 1463054720140.png [View same] [iqdb] [saucenao] [google]
1349801

>>1339052
>tfw my uni gives me a full MATLAB license valid for my entire uni enrolment (usually priced at $2000+) complete free of charge

>> No.1349945

>>1349801
Mine too, glorious, isn't it?

>> No.1349967

>>1349945
Truly grand, indeed.

>> No.1350258

>>1338993
Please anon, much appreciated.
algotrade@national.shitposting.agency

>> No.1350400

>>1346208

>>1339693 here

I've also entertained a system like that. But I'm kind stumped regarding a good source of data for this. Do you use scrapping AF or have you managed to find a good source?

>> No.1350425

>>1348475
Do you have any tips regarding what skills a CS student should develop in order to get into quant trading?

>> No.1350465

>>1350400
Same here. Quaint stuff has always interested me but the gambling has always appealed a bit more. But yeah it's just a shit load of scraping and xpaths. I'm pretty sure I know more about the layout of some sites than their devs because of the amount of scraping. Some sports you can find good databases/api it just depends. I also think sports can be more profitable in a lot of cases vs trading because of the guesswork/gut feeling most people go on. Which if you have a good system built will crush them every time.

>> No.1350469

>>1349801

Myself as well, except mine was paid for by the US Government. Iraq War vet here, told them I needed more school to get desired civilian career. Did M.Sc. in Applied Mathematics, fully paid for, with housing allowances. They said they'd pay for any books or equipment. Told them I needed a $2,000 laptop and Matlab and about $1,000 in textbooks.

Got to keep all the books and equipment, but now have six-figure data analyst job. Use equipment to do machine learning shit evenings and weekends.

So...thanks, fuckers.

>> No.1350473

>>1338101
>NN model

Do you have a kickass GPU or some AWS time. You're gunna need that anon!

>doesn't know about training sets.

>> No.1350477
File: 1.18 MB, 1044x634, auto_del_3d.gif [View same] [iqdb] [saucenao] [google]
1350477

>>1339074
do you use weka?

>>1339052
MatLab is good Python has scikit-learn which is great too

>I'm a PhD student in biology. I have some machine learning experience in python for genetic questions.

attached is my training set for one classifiers.

>Ask me general machine learning questions

>> No.1350500

>>1340060

Are you against double-majoring? That was my route and it had paid off handsomely.

>> No.1350587

>>1350469
That's fucking awesome, living the dream

>> No.1350667

>>1338993
Please send this to me as well. Thank you so much, anon.

42kcwu+4okhzctasz1gg@sharklasers.com

>> No.1351839

Glad its over

>> No.1352979

How good is back testing amongst random dates and profits averaged together?

>> No.1354244

>>1352979
Couldn't tell you specifically but in machine learning stochastic approaches often give very accurate results.

>> No.1354273

>>1338027
Does anyone use stochastic models or operations research techniques?